-- Logs begin at Wed 2022-06-29 10:32:38 UTC, end at Wed 2022-06-29 11:34:09 UTC. -- Jun 29 11:03:41.322741 dv-cinder-847335-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 11:03:41.329965 dv-cinder-847335-2-smb devstack@keystone.service[80054]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 11:03:41 2022] *** Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: nodename: dv-cinder-847335-2-smb Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: machine: x86_64 Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: clock source: unix Jun 29 11:03:41.331982 dv-cinder-847335-2-smb devstack@keystone.service[80054]: pcre jit disabled Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: detected number of CPU cores: 4 Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: current working directory: / Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: detected binary path: /usr/bin/uwsgi-core Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: your processes number limit is 47680 Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: your memory page size is 4096 bytes Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: detected max file descriptor number: 2048 Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: lock engine: pthread robust mutexes Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: thunder lock: enabled Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 11:03:41.332429 dv-cinder-847335-2-smb devstack@keystone.service[80054]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 11:03:41.378115 dv-cinder-847335-2-smb devstack@keystone.service[80054]: Python main interpreter initialized at 0x556c346f79c0 Jun 29 11:03:41.378115 dv-cinder-847335-2-smb devstack@keystone.service[80054]: python threads support enabled Jun 29 11:03:41.378115 dv-cinder-847335-2-smb devstack@keystone.service[80054]: your server socket listen backlog is limited to 100 connections Jun 29 11:03:41.378115 dv-cinder-847335-2-smb devstack@keystone.service[80054]: your mercy for graceful operations on workers is 90 seconds Jun 29 11:03:41.378481 dv-cinder-847335-2-smb devstack@keystone.service[80054]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 11:03:41.378629 dv-cinder-847335-2-smb devstack@keystone.service[80054]: *** Operational MODE: preforking *** Jun 29 11:03:41.378944 dv-cinder-847335-2-smb devstack@keystone.service[80054]: *** uWSGI is running in multiple interpreter mode *** Jun 29 11:03:41.378944 dv-cinder-847335-2-smb devstack@keystone.service[80054]: spawned uWSGI master process (pid: 80054) Jun 29 11:03:41.379181 dv-cinder-847335-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 29 11:03:41.382501 dv-cinder-847335-2-smb devstack@keystone.service[80054]: spawned uWSGI worker 1 (pid: 80058, cores: 1) Jun 29 11:03:41.382501 dv-cinder-847335-2-smb devstack@keystone.service[80054]: spawned uWSGI worker 2 (pid: 80059, cores: 1) Jun 29 11:03:41.382501 dv-cinder-847335-2-smb devstack@keystone.service[80054]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 11:03:46.772490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:03:46.772490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: from cryptography.utils import int_from_bytes Jun 29 11:03:46.773293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:03:46.773293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: from cryptography.utils import int_from_bytes Jun 29 11:03:46.773399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:03:46.773399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes Jun 29 11:03:46.773798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 11:03:46.773798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes Jun 29 11:03:46.821893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 11:03:46.822080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 11:03:46.822172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 11:03:46.822257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] command line args: [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 11:03:46.822328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 11:03:46.822462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] command line args: [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 11:03:46.822551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 11:03:46.822683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ================================================================================ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 11:03:46.822769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 11:03:46.822902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ================================================================================ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 11:03:46.822987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] admin_token = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config_dir = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] config_dir = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config_source = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] debug = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] config_source = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.823931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] debug = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.824937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_config_append = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_config_append = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_dir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_dir = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.825943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.826953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.827985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.828927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.829054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.829183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.829331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.829670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.829816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.829962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] publish_errors = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] publish_errors = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.830875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] standard_threads = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] standard_threads = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.831905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_journal = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_json = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] use_journal = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_stderr = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] use_json = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.832927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_syslog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.833051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] use_stderr = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.833051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] use_syslog = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.833268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.833385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 11:03:46.833505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.833617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.833738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.833857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.833970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.833970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.834792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.834906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835431 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.835890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836127 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.836920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.837943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.838977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.839915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.840959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.841979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.842998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843547 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.843895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.844967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.845894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846460 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.846955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.847906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.848943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.849974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.850986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.851914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.852918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.853923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.854925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.855920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.856959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.857892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.external = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.858922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.external = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.password = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.token = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.859911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.password = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] auth.token = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.860960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.861898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.862941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.863896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864135 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.864955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.865079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.865079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.865786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.865905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.866956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.867958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.868883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.869902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.870940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.871894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.872949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.873882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874697 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.874925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.875979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.876791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.877943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.878981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.879968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.880896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.881612 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.881731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.881846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.881959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.882906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.883984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.884904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.885952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.886827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.887994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.888918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.889961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.890993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.891825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892127 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.892933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893046 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] role.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] role.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.893968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.894900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.895967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.896897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.897913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.898941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.899914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.900950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.901980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.902896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.903965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.904906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.905932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.906992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.907943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 11:03:46.908529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 11:03:46.937071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.937297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.937522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.938202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.938440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.938671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.946577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.948056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.974321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.974545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.976003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:46.976240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.117928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.118138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.168071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.168306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.171916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.172152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.234558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.234784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.234874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.235924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.260974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.261993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.262075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.262204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.262286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.262415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.273518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.273615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.286944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.287028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.287712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.287801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.287927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.288009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.288192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80059) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 11:03:47.305800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.306008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 11:03:47.306092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.306242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 11:03:47.306339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.306525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 11:03:47.306611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.306773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 11:03:47.306855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.307818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.318316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.318617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.318749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.318878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.319019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.319187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.319321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.319541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.327405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.327848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.330669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.330944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.331160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.331288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.331428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.331567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.331694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.331820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.331978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.332887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.333022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.333149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.333275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.333399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.333526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.333771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.360286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.360901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.361894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.362167 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.362528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.362811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.368168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.368389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.368720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.368851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.368991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.369385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.376268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.376548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.376745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.377032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.381042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.381333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.381615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.381898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.382110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.382238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.382400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.382525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.382679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.382815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.382949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.383102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.383255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.383532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.383803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.384073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.401542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.401811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.402903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.403207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.406366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.407919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.410004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.410294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.411609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.411909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.415963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.417608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.419664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.421280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.423334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.423626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.423902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.424179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.424469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.424745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.424974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.425274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.425561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.425850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.426140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.426694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.444570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.444845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.445109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.445369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.446455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.446749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.447020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.447309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.453264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.454969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.455263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.455434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.456985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.457263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.458429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.458706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.458982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.459329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.459613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.460540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.460825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.461109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.461405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.461683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.472806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.473085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.473372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.473652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.473930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.475596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.475880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.476055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.476182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.476363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.476487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.476707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.478311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.478613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.494706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.497102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.497982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.500445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.501310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.503078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.503813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.504716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.504990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.505263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.505570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.507267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.507550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.507860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.512696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.514292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.515238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.516910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.517528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.517820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.518216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.518492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.520184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.520479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.520878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.521168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.527630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.527911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.528192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.530372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.530662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.530948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.536029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.536307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.536585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.536856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.537638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.538031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.538318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.538586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.538860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.539163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.539442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.539522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80059) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 11:03:47.539707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.539801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.539968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.540049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.540228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.540364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.540509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.540892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.541176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.541466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.541750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.542028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.542304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.542570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.542840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.543148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80059) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 11:03:47.578694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c346f79c0 pid: 80058 (default app) Jun 29 11:03:47.581648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556c346f79c0 pid: 80059 (default app) Jun 29 11:03:47.582052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255728-bdfc-4a1a-85a6-16fb53303627 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:47.582345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255728-bdfc-4a1a-85a6-16fb53303627 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:47.582626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9255728-bdfc-4a1a-85a6-16fb53303627 None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:47.586819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Wed Jun 29 11:03:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:03:55.235686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:55.236248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:55.236248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:55.241136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:03:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:03:55.246427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71981-9861-414a-9273-51a554103505 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:55.246815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71981-9861-414a-9273-51a554103505 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:55.246986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71981-9861-414a-9273-51a554103505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:55.315733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: INFO dbcounter [None req-14a71981-9861-414a-9273-51a554103505 None None] Registered counter for database keystone Jun 29 11:03:55.336959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG oslo_db.sqlalchemy.engines [None req-14a71981-9861-414a-9273-51a554103505 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:03:55.343181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writer thread running {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:03:55.522981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-14a71981-9861-414a-9273-51a554103505 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80058) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 11:03:55.523437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-14a71981-9861-414a-9273-51a554103505 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80058) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 11:03:55.577679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-14a71981-9861-414a-9273-51a554103505 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:03:55.579266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-14a71981-9861-414a-9273-51a554103505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:03:55.703350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:03:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 29 11:03:55.868782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:03:55.937994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: INFO dbcounter [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] Registered counter for database keystone Jun 29 11:03:55.957061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG oslo_db.sqlalchemy.engines [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 11:03:55.963786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writer thread running {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 11:03:56.081281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1ee7-5c97-48e4-a016-41d113e2f070 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:03:56.086075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:03:56.086741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:56.087030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:56.087332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:56.095347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:03:56.152482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 11:03:56.152756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8d7a-4593-4baa-b6b9-5f68a8ca7e87 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:03:56.163767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Jun 29 11:03:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:03:56.169931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71981-9861-414a-9273-51a554103505 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:03:56.184776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71981-9861-414a-9273-51a554103505 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:03:56.189217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:03:56.190336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:56.190625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:56.190904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] PATH_INFO: `/v3/projects/06d95d128265441e8d2bda222376dded` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:56.192411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=06d95d128265441e8d2bda222376dded)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:03:56.246744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 11:03:56.247353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7907f9f6-01f2-496a-af20-e4aadc1cb1f1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:03:56.251678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Wed Jun 29 11:03:56 2022] GET /identity/v3/projects/06d95d128265441e8d2bda222376dded => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:03:58.222199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32572379-8961-4f7d-bad9-cbe1db89011d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:58.222721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32572379-8961-4f7d-bad9-cbe1db89011d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:58.222804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32572379-8961-4f7d-bad9-cbe1db89011d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:58.226947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:03:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:03:58.232331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:58.232699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:58.232905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:58.251882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:03:58.253332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:03:58.261664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:03:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 11:03:58.283657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32572379-8961-4f7d-bad9-cbe1db89011d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:03:58.295540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32572379-8961-4f7d-bad9-cbe1db89011d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:03:58.299743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf672a8-709d-4152-9a9e-10c61d17ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:03:58.300363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf672a8-709d-4152-9a9e-10c61d17ae43 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:58.300650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf672a8-709d-4152-9a9e-10c61d17ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:58.300928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf672a8-709d-4152-9a9e-10c61d17ae43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:58.309324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf672a8-709d-4152-9a9e-10c61d17ae43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:03:58.311110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf672a8-709d-4152-9a9e-10c61d17ae43 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:03:58.320249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Jun 29 11:03:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:03:58.325362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:03:58.334292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62ba57-5967-42e3-99c4-862b8a2c08cf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:03:58.338695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd525be-02de-4954-acdb-25c5669fcf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:03:58.339598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd525be-02de-4954-acdb-25c5669fcf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:03:58.339891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd525be-02de-4954-acdb-25c5669fcf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:03:58.340170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd525be-02de-4954-acdb-25c5669fcf3b admin admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:03:58.341560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd525be-02de-4954-acdb-25c5669fcf3b admin admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:03:58.343442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd525be-02de-4954-acdb-25c5669fcf3b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:03:58.345008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Wed Jun 29 11:03:58 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:00.401728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5292c0-b17d-4211-bcb6-8ae7f5141565 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.402259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5292c0-b17d-4211-bcb6-8ae7f5141565 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.402259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5292c0-b17d-4211-bcb6-8ae7f5141565 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.403674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:00.408718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.409132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.409409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.426709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:00.427971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:00.469889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76145e4b-c8a0-4c51-837a-b6aaf09074c4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.470179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76145e4b-c8a0-4c51-837a-b6aaf09074c4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.470457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76145e4b-c8a0-4c51-837a-b6aaf09074c4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.471851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:00.477454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.477753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.478039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.509469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:00.517524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG passlib.handlers.bcrypt [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80059) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 11:04:00.517953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG passlib.handlers.bcrypt [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80059) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 11:04:00.532606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:00.556717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:00.564045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:00.565610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:00.635118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87e40-2fab-4757-89b4-368c87c7d4fa None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:00.666022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:00.668275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:00.669066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.669353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.669630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.684826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:00.687966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:00.696349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:00.697414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:00.698441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:00.705108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:00.789716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab9d3b-9c5f-4606-86c0-33bbbef539f4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:00.791427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:00.792110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:00.811099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b702b-5ffe-459e-be4f-219effff1dd7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:00.827708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:00.828597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.828888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.829164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.845966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:00.846623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:00.846909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:00.847216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:00.847968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:00.848275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:00.849670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:00.861347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:00.866678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:00.897112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:00.898629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:00.966998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee1561-b61b-4bb0-86fc-c4a4d929ce91 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:00.997713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:04:01.000255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:01.000596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:01.000883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:01.001163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:01.002380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:01.002990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:01.003907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:01.007081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:00 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:01.007304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:01.011453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:01.027372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:01.101700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd322b0a-94fb-40a3-ab0f-fe2101986e44 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:01.112475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728ad50-ccd2-4166-a90f-df0a9e794149 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:01.137420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:01.138205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:01.138496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:01.138778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:01.145729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:01.146521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:01.146809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:01.147116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:01.148298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:01.149765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:01.151404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:01.156999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:01.157327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:01.158457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:04:01.179560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:01.180418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:01.181196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:04:01.181196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:04:01.181196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:04:01.181196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:01.181196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:01.187374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:01.237022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:01.243124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:01.257782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a995e-8476-4a1d-885e-a8da9aebdd8c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:01.288369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28584970-88bf-4a74-9468-18dfcf7e97db None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:01.291706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:01.292365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:01.292651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:01.292932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:01.293760 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.domain.id=default, user.id=ba85a3628d384dd78869d3e23b87ec91) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:01.294076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:01.295558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3958bf-6a04-4096-bcb7-170b7dec0288 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:01.303105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Jun 29 11:04:01 2022] GET /identity/v3/role_assignments?user.id=ba85a3628d384dd78869d3e23b87ec91&scope.domain.id=default&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:01.324649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:01.325343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:01.325636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:01.325924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:01.326679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:01.326994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:01.328467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41c82d-4a1e-4fc4-8f09-a62ef8d99b80 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:01.347820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:03.618074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308def40-19f5-44e3-b12d-c05f61c4b518 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:03.619126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308def40-19f5-44e3-b12d-c05f61c4b518 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:03.619653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308def40-19f5-44e3-b12d-c05f61c4b518 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:03.621224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:03.636578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:03.637474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:03.637975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:03.660094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:03.661328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:03.749792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:03.783437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308def40-19f5-44e3-b12d-c05f61c4b518 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:03.932572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308def40-19f5-44e3-b12d-c05f61c4b518 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:03.979878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:03.981108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:03.981599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:03.982070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.011998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:04.020050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:04.020866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:04.022263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:04.024619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 13/24] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:04.030529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:04.096607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:04.171422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a846c-1943-4f71-a1c6-8e8ce74cb942 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:04.217033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:04.217642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.217934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.218219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.218978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:04.219317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:04.220711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1bc8f-93dc-4606-bfd3-ce67d0df34fb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:04.237974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 12/25] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:04.243634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:04.254116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:04.311503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8d6aa-60ce-40d0-b3fa-cc4664d3136a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.312125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8d6aa-60ce-40d0-b3fa-cc4664d3136a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.312712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8d6aa-60ce-40d0-b3fa-cc4664d3136a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.314276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 13/26] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:04.331624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfbcc0-f721-41d5-8749-a9b92b870a3a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.332194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfbcc0-f721-41d5-8749-a9b92b870a3a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.332882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfbcc0-f721-41d5-8749-a9b92b870a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.354687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ffbfbcc0-f721-41d5-8749-a9b92b870a3a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:04.356311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ffbfbcc0-f721-41d5-8749-a9b92b870a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:04.399604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac66fe5-7412-41c3-9e2c-471e589bb772 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:04.431474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:04.433068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d63581-4d15-4010-893b-6df7e0654a9d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.433560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d63581-4d15-4010-893b-6df7e0654a9d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.434160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d63581-4d15-4010-893b-6df7e0654a9d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.435671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 15/28] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:04.436913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ca56-43dd-4bc2-9eff-c47191f30aee None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.437396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ca56-43dd-4bc2-9eff-c47191f30aee None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.437873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4ca56-43dd-4bc2-9eff-c47191f30aee None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.439286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 16/29] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:04.446735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.447311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.447842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.449197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ee94e-d3aa-44d6-8607-5101a4a7a6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:04.450178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee94e-d3aa-44d6-8607-5101a4a7a6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.450564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee94e-d3aa-44d6-8607-5101a4a7a6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.450942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ee94e-d3aa-44d6-8607-5101a4a7a6a0 None admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.458475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee94e-d3aa-44d6-8607-5101a4a7a6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:04.461188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ee94e-d3aa-44d6-8607-5101a4a7a6a0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:04.463313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 14/30] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:04 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:04.464690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.465238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.465705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.478230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:04.479394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:04.488013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:04.489418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:04.515246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:04.567369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:04.568608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:04.576436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 15/32] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:04.579345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:04.588304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:04.715108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e0ba0-7bff-418e-844e-4daec93a28af None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:04.736794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7ccb-ca2c-4e3f-9c29-874b9b3e56da None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:04.760769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:04.761904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.762332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.762746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.777051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:04.778836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:04.780076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:04.781362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.782139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.782678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.784219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:04.785984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:04.788366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:04.789324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:04:04.806739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:04.807633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:04.808449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:04:04.808449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:04:04.808449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:04:04.808449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:04.808449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:04.809379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:04.838126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:04.880236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:04.915466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477282b-0a9d-4600-8e70-cce53b3fbadd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:04.923359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540028ae-219b-4e96-9e40-c08a359254e3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:04.952340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:04.953374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.953867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.954340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.955366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:04.956951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:04.960257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:04.960958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:04.961285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:04.961587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:04.962338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:04.964360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.086725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jun 29 11:04:04 2022] POST /identity/v3/roles => generated 225 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:05.086725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:05.091434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 19/36] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jun 29 11:04:04 2022] POST /identity/v3/roles => generated 219 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:05.092478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:05.222260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:05.239525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4263af2-e573-4f15-9d7c-6f12d2e2a56e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:05.249167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12d336-2a3b-45b0-b088-d76de6da3fc5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:05.284915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:05.293864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa381e6-b80b-45b3-9929-b61f287e0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:05.294787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa381e6-b80b-45b3-9929-b61f287e0b21 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.295155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa381e6-b80b-45b3-9929-b61f287e0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.295447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa381e6-b80b-45b3-9929-b61f287e0b21 None admin] PATH_INFO: `/v3/domains/default/users/ba85a3628d384dd78869d3e23b87ec91/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.298504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa381e6-b80b-45b3-9929-b61f287e0b21 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ba85a3628d384dd78869d3e23b87ec91, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:05.298712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:05.299427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.299723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.300010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.300184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa381e6-b80b-45b3-9929-b61f287e0b21 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.300753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:05.301069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:05.302865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f4b03-ad9d-4526-baaf-d378cf4c529b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.316917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1361 bytes} [Wed Jun 29 11:04:05 2022] PUT /identity/v3/domains/default/users/ba85a3628d384dd78869d3e23b87ec91/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:05.319020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b50c4-0d48-4786-a917-e092ac2bf56a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.319513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b50c4-0d48-4786-a917-e092ac2bf56a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.319737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b50c4-0d48-4786-a917-e092ac2bf56a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.321978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 19/38] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:05.322703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e090382-b9fd-47bd-ab6b-7fea1a4d6ad6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.323073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e090382-b9fd-47bd-ab6b-7fea1a4d6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.323361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e090382-b9fd-47bd-ab6b-7fea1a4d6ad6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.324217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 20/39] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:05.324684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 20/40] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:05.330102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.330408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.330613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.330724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.330921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.331245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.352549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:05.354135 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:05.356037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:05.357670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:05.436966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:05.437846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:05.529570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:05.541994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 21/42] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:05.543235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:05.573632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cfe08-5c9b-41e4-8a32-5b7596b65f77 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:05.608447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:05.609140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.609409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.609693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.610648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:05.612149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.650555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 22/43] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:04:05 2022] POST /identity/v3/projects => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:05.650555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:05.655402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013091b6-fd8b-41cf-b3e8-190cd03d5f63 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:05.682158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:05.704085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:05.705032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.705434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.705728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.706983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:05.708660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.710610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 22/44] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:05.716399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:05.799146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eef5d-0f45-4e8b-bacb-6593a6bfe006 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:05.829426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:05.839906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f1685-b762-426e-8767-0b3e46437cc6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:05.848958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc92937-c0cc-445e-b667-13aca69c71f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:05.849692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92937-c0cc-445e-b667-13aca69c71f5 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.849969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92937-c0cc-445e-b667-13aca69c71f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.850362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc92937-c0cc-445e-b667-13aca69c71f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.851928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92937-c0cc-445e-b667-13aca69c71f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:05.854591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc92937-c0cc-445e-b667-13aca69c71f5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.874129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jun 29 11:04:05 2022] POST /identity/v3/roles => generated 223 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:05.884164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf13e4-0f87-4564-9907-36ebc4be2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:05.884956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf13e4-0f87-4564-9907-36ebc4be2862 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:05.885320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf13e4-0f87-4564-9907-36ebc4be2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:05.885692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf13e4-0f87-4564-9907-36ebc4be2862 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:05.886495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf13e4-0f87-4564-9907-36ebc4be2862 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:05.888145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf13e4-0f87-4564-9907-36ebc4be2862 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:05.922824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:04:05 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:07.383665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45af2a-ec90-48f6-ac85-03b3198a4309 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:07.384173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45af2a-ec90-48f6-ac85-03b3198a4309 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:07.384252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45af2a-ec90-48f6-ac85-03b3198a4309 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:07.385638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:07.390859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:07.391271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:07.391484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:07.408085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:07.409282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:07.442763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:07.476346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:07.499686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45af2a-ec90-48f6-ac85-03b3198a4309 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:07.611898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45af2a-ec90-48f6-ac85-03b3198a4309 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:07.644366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:07.645083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:07.645370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:07.645648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:07.657725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:07.666964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:07.667824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:07.668808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 25/49] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:07.673883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:07.770683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2790a-b4d5-4aac-89a1-d76406e06bc4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:07.805239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:07.805902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:07.806192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:07.806475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:07.807268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:07.807582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:07.808981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21e2bd-2e79-4fc6-95d5-46d8ad56c184 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:07.817113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 25/50] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:07.822731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:07.947427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00efa37-3bbb-4766-9a9e-cdc30a3093a4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:07.947644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00efa37-3bbb-4766-9a9e-cdc30a3093a4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:07.947930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00efa37-3bbb-4766-9a9e-cdc30a3093a4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:07.949358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 26/51] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:07.954136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:07.954429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:07.954715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:07.971974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:07.973190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:07.975793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:08.000880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:08.033689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8622ea-5a38-4c55-945a-89ad33cbb0b4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:08.043316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 27/52] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:08.066136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:08.067229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:08.068135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:08.068426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:08.068697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:08.070114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:08.071595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:08.073213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:07 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:08.078383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:08.164837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560ea0c-642a-4a09-81b6-fc83cc0c66db None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:08.182090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c731605-8802-4766-b491-a7bb991fd0d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:08.192714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:08.198397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:08.199180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:08.199475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:08.199766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:08.200951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:08.202406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:08.204058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:08.210940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:08.218121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:08.218923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:08.219249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:08.219535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:08.220718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:08.222156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:08.223793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:08.229871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:08.240729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:08.310839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd89b3-3d3a-419d-8537-224a4f7d0f79 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:08.327393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995370a2-fa00-4fcf-ab8d-857ddddc7a10 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:08.344512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ea5ff-3c36-419a-ad17-7168e0e13087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:08.345164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ea5ff-3c36-419a-ad17-7168e0e13087 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:08.345452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ea5ff-3c36-419a-ad17-7168e0e13087 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:08.345733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ea5ff-3c36-419a-ad17-7168e0e13087 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:08.346439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ea5ff-3c36-419a-ad17-7168e0e13087 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:08.347915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ea5ff-3c36-419a-ad17-7168e0e13087 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:08.360435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:08.361076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:08.361371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:08.361660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:08.362489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.domain.id=default, user.id=ba85a3628d384dd78869d3e23b87ec91) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:08.362843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:08.364348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e30b7-7751-48f3-8e4c-b1dfb596a8e4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:08.371885 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 29/56] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Jun 29 11:04:08 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:04:08.375909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Jun 29 11:04:08 2022] GET /identity/v3/role_assignments?user.id=ba85a3628d384dd78869d3e23b87ec91&scope.domain.id=default&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:10.413622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6e18-433c-4b26-8328-733d201698f1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:10.414126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6e18-433c-4b26-8328-733d201698f1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:10.414212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd6e18-433c-4b26-8328-733d201698f1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:10.415594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:10.420678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:10.421035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:10.421285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:10.437955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:10.439153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:10.473273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:10.505133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:10.529814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6e18-433c-4b26-8328-733d201698f1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:10.609951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:10.631312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd6e18-433c-4b26-8328-733d201698f1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:10.664696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f36a2-137b-4b72-aa4e-8910bae3c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:10.665423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f36a2-137b-4b72-aa4e-8910bae3c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:10.665713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f36a2-137b-4b72-aa4e-8910bae3c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:10.665996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f36a2-137b-4b72-aa4e-8910bae3c0ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:10.667198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f36a2-137b-4b72-aa4e-8910bae3c0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:10.668657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f36a2-137b-4b72-aa4e-8910bae3c0ce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:10.670256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:10.675662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:10.775677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2107034-5868-4a6c-b204-3fe971f595ac None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:10.808112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3657e41-e703-4e86-9a76-f597a66b484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:10.808775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657e41-e703-4e86-9a76-f597a66b484c None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:10.809069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657e41-e703-4e86-9a76-f597a66b484c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:10.809355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3657e41-e703-4e86-9a76-f597a66b484c None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:10.810075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657e41-e703-4e86-9a76-f597a66b484c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:10.811557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3657e41-e703-4e86-9a76-f597a66b484c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:10.837285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:10 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:13.929561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e3e2-3287-41aa-93e2-b117ad17a411 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:13.930586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e3e2-3287-41aa-93e2-b117ad17a411 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:13.931128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e3e2-3287-41aa-93e2-b117ad17a411 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:13.932704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:13.938041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9150-0827-4c99-b4d3-02f9ce800fe7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:13.938862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9150-0827-4c99-b4d3-02f9ce800fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:13.939379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e9150-0827-4c99-b4d3-02f9ce800fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:13.960053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d15e9150-0827-4c99-b4d3-02f9ce800fe7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:13.961587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d15e9150-0827-4c99-b4d3-02f9ce800fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:13.989696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.061551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:14.101643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e3e2-3287-41aa-93e2-b117ad17a411 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.136512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d70f-0292-4848-bbb9-4b9364ceccb9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.136826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d70f-0292-4848-bbb9-4b9364ceccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.137093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4d70f-0292-4848-bbb9-4b9364ceccb9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.138475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 32/64] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:14.146261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61215-c52a-44f6-9cb3-f6cbeb9a86e7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.146558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61215-c52a-44f6-9cb3-f6cbeb9a86e7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.146842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c61215-c52a-44f6-9cb3-f6cbeb9a86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.172756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-86c61215-c52a-44f6-9cb3-f6cbeb9a86e7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:14.173945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86c61215-c52a-44f6-9cb3-f6cbeb9a86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:14.249810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e3e2-3287-41aa-93e2-b117ad17a411 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.275163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:14.282732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd476f-b9f6-4353-9943-88fc3f7326cf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.283327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd476f-b9f6-4353-9943-88fc3f7326cf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.283945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd476f-b9f6-4353-9943-88fc3f7326cf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.285825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 34/66] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:14.290511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.291453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.291556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.291817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.292176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.292348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.292876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.304868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:14.313070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:14.314137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:14.315186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:14.317505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 33/67] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:14.322722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.324239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:14.325557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:14.337422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.410727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:14.415067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.433629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.461364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df590ce-5929-47e7-8bf1-cd5eec439f11 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.499569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.500797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.501374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.501845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.513810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:14.522870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:14.523860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:14.524622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:14.526959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:14.527953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.542284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467438bf-c43d-4307-ab0a-cbdae1109389 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.579500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.580185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.580477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.580764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.581519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:14.581837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:14.583264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:14.592368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:14.593147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.606214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.637359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f7537-a20d-4071-9cd6-f5cdc479b317 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.670511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594032f-f0c0-4852-90f2-44759d68af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.671326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594032f-f0c0-4852-90f2-44759d68af02 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.671618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594032f-f0c0-4852-90f2-44759d68af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.671905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594032f-f0c0-4852-90f2-44759d68af02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.674241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.682656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594032f-f0c0-4852-90f2-44759d68af02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7594032f-f0c0-4852-90f2-44759d68af02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:14.690573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:14.691482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:14.692231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:14.693425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51cb6c-9c43-4641-a3b2-d07ce5e52d30 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.693425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51cb6c-9c43-4641-a3b2-d07ce5e52d30 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.693631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51cb6c-9c43-4641-a3b2-d07ce5e52d30 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.695018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 36/72] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:14.695985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330549-8a9a-403b-a2fe-651d524444f2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.696275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330549-8a9a-403b-a2fe-651d524444f2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.696557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef330549-8a9a-403b-a2fe-651d524444f2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.697764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 37/73] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:14.698559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330549-8a9a-403b-a2fe-651d524444f2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.699592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd76d5-d7e7-47e8-8705-d35ac922ad39 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.734084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.734755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.735066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.735353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.736102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:14.736417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:14.737804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:14.745872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:14.746644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.799623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef330549-8a9a-403b-a2fe-651d524444f2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.830692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.838086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876621f-aa9e-4ed7-a023-d563e02719ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.838959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876621f-aa9e-4ed7-a023-d563e02719ff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.839286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876621f-aa9e-4ed7-a023-d563e02719ff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.839563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876621f-aa9e-4ed7-a023-d563e02719ff None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.853105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876621f-aa9e-4ed7-a023-d563e02719ff None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:14.853754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c620ef7-5c3e-45dc-b63d-9a1ae0263f37 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:14.854585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876621f-aa9e-4ed7-a023-d563e02719ff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:14.856552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:14.857560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.857855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.858137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.873519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:14.874688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:14.886861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:14.887718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.888199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.888689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.890070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:14.890637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:14.893317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a29da4-9c2f-4632-a3f4-e03087bc4102 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:14.904611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:14.905831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:14.906125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:14.906415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:14.912833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:14.923691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:14.924887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:14.946340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 39/77] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:14.947265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:14.997740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 39/78] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:14.997740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.057021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e7b9c-7380-4a8d-b1f2-010dc2c8f1bc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.074417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.092654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.093535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.093826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.094107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.095338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.096798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.103305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:15.103305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.103785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3272a-e592-47d6-8dab-bbe25bfd0296 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.137549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.138203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.138544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.138785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.141410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.198469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52894-1428-4a7a-b202-62c17109511b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.207784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.209282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.231306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.232170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.232459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.232739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.233938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.235404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.237010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:15.237763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.296233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.312385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 40/81] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:15.313150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.344935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.346344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd448c-8cd6-4a42-816d-f5818e4417b0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.379925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.380741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.381033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.381318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.382484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.383969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.385578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:15.387523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.413269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20aab4f-80c4-4def-ba88-689e257f3b2e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.446919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.447739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.448024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.448300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.458223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:15.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:15.467479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:15.468251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 41/83] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:15.468874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.487627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465cef8-9f1c-4e2e-9932-a74ac6b06f2d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.508783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.520603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.521770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.522058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.522332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.561339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.569009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31277-87c7-4075-b9a9-4412c50fbb74 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.589241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.590731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.606681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.607360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.607652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.607932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.677518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.678999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.690249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 43/84] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:15.691467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.714976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.769549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.777745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 42/85] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:15.778535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.789798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2902d-eba7-476c-a272-ee95e75c6582 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.823669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.824466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.824891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.825173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.826369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.827865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.829561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 44/86] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:15.830317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.881718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43219693-8a48-4ca3-88b3-f83fba400228 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.915531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.916203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.916492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.916776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.917498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.918936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.920105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:15.930526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31e48-0e0b-4cc0-b680-eab42f65948b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:15.938410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 43/87] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:15 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:15.939352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:15.974996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:15.975759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:15.976001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:15.976281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:15.977133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:15.977354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:15.978799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:15.989955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 45/88] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:15.989955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.003000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:16.064761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c0c7b-ff83-4816-b547-9dc5c7121155 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.112415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.114497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.114497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.114657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d451de5-f30e-4c94-b4e7-f86f9a1b57d8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.114728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.117719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.117719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.120539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 44/89] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:16.123329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.154752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.155660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.155953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.156240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.159377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.159377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.160649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:15 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:16.161417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.190283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:16.255129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446973f2-fc92-4bf2-b8ba-d90b904031c1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.282910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:16.288672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1fe2d-d7bf-46bb-b4e3-c81c883d8f4a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.296558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.297676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.297978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.298454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.299726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=af097cba5b204232b159af38f2488126, user.id=3d323dabd4b9465085858a1023b364cc) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:16.300062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.302934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.309877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 45/91] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:16 2022] GET /identity/v3/role_assignments?user.id=3d323dabd4b9465085858a1023b364cc&scope.project.id=af097cba5b204232b159af38f2488126&role.id=bcc6944090e84b989e96027d0859ed4b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:16.310702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.330703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.331731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.332031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.332323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.333689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.335473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.337397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 47/92] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:16 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:16.338506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.425058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd96aa-ffb0-4aa3-b913-01270796028c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.444513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:16.459475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb17be-02ed-4e5c-af03-25ee38e80c0d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.463342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.464025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.464326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.464618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.465490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] RBAC: Adding query filter params (role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=af097cba5b204232b159af38f2488126, user.id=3d323dabd4b9465085858a1023b364cc) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:16.465815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.467367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.474024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:16 2022] GET /identity/v3/role_assignments?user.id=3d323dabd4b9465085858a1023b364cc&scope.project.id=af097cba5b204232b159af38f2488126&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:16.475275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.501069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.501755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.502049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.502337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.503512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=af097cba5b204232b159af38f2488126, user.id=ba85a3628d384dd78869d3e23b87ec91) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:16.503847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.505450 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.514366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:16 2022] GET /identity/v3/role_assignments?user.id=ba85a3628d384dd78869d3e23b87ec91&scope.project.id=af097cba5b204232b159af38f2488126&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:16.528587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:16.595556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2b251-b64d-4e7c-bc5e-4daca24eab75 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.634250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.634926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.635277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.635570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.716004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.717454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:16.775006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:16.833408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 47/95] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:16.839466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:16.954524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4cf55-1d57-4fe3-823d-67b2aaefe510 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:16.994939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763bd3-23bb-4d2e-b50c-b59cd5fa2a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:16.995828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763bd3-23bb-4d2e-b50c-b59cd5fa2a91 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:16.996125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763bd3-23bb-4d2e-b50c-b59cd5fa2a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:16.996413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763bd3-23bb-4d2e-b50c-b59cd5fa2a91 None admin] PATH_INFO: `/v3/projects/37e909970ff94530b8c9f058918676cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:16.997654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763bd3-23bb-4d2e-b50c-b59cd5fa2a91 None admin] RBAC: Authorizing `identity:get_project(project_id=37e909970ff94530b8c9f058918676cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:16.999246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763bd3-23bb-4d2e-b50c-b59cd5fa2a91 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:17.001030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:16 2022] GET /identity/v3/projects/37e909970ff94530b8c9f058918676cd => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:17.007571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:17.117483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c2103-9236-424c-891d-9caa0884ca01 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:17.153169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:17.153840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:17.154132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:17.154421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:17.155308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=37e909970ff94530b8c9f058918676cd, user.id=3d323dabd4b9465085858a1023b364cc) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:17.155637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:17.157093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b42a1-943f-4924-8b88-2f16f1f596b6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:17.163412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:17 2022] GET /identity/v3/role_assignments?user.id=3d323dabd4b9465085858a1023b364cc&scope.project.id=37e909970ff94530b8c9f058918676cd&role.id=bcc6944090e84b989e96027d0859ed4b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:18.932578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794536c-cbdc-44ce-be81-7fca5aec2a71 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:18.933096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794536c-cbdc-44ce-be81-7fca5aec2a71 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:18.933170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794536c-cbdc-44ce-be81-7fca5aec2a71 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:18.934856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:18.940402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce737-20bf-44c7-a592-a0572744a855 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:18.940868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce737-20bf-44c7-a592-a0572744a855 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:18.940991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bce737-20bf-44c7-a592-a0572744a855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:18.966856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f9bce737-20bf-44c7-a592-a0572744a855 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:18.968151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f9bce737-20bf-44c7-a592-a0572744a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:18.971289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:19.089091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:19.124527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794536c-cbdc-44ce-be81-7fca5aec2a71 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:19.152504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:19.188086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68074e7-f40d-4aac-a478-e707fa79804d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.188677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68074e7-f40d-4aac-a478-e707fa79804d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.189159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68074e7-f40d-4aac-a478-e707fa79804d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.190756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 50/100] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:19.196365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.196923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.197401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.219071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:19.219071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:19.284703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794536c-cbdc-44ce-be81-7fca5aec2a71 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:19.303118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 51/101] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:19.326200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:19.363011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:19.363849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.364147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.364431 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.392673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:19.404303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:19.405166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:19.405983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:19.410456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:19.411433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:19.450117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:19.501947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c82bd0-7c09-43af-847b-9b9a50b0e911 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:19.556485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab9715-8574-4ace-8c2c-53751adc3cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:19.557309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9715-8574-4ace-8c2c-53751adc3cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.557600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9715-8574-4ace-8c2c-53751adc3cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.557885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab9715-8574-4ace-8c2c-53751adc3cd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.559738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9715-8574-4ace-8c2c-53751adc3cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:19.561218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab9715-8574-4ace-8c2c-53751adc3cd6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:19.563018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 52/103] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:19.564129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471ac43-97d5-4ed6-ac18-efe81ecd3af0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.564682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471ac43-97d5-4ed6-ac18-efe81ecd3af0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.566902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471ac43-97d5-4ed6-ac18-efe81ecd3af0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.573551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 53/104] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:19.574161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471ac43-97d5-4ed6-ac18-efe81ecd3af0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:19.602563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:19.662552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda2003-7646-4121-a3a2-2c1c42aea7fb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:19.702837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471ac43-97d5-4ed6-ac18-efe81ecd3af0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:19.705642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:19.706572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.707106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.707605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.709398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:19.709923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:19.712406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c2d5f-289b-429f-a0bf-a65b6e63ed18 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:19.721974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 52/105] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:19.725469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.725990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.726469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.739262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:19.740388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:19.740695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:19.740978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:19.741702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:19.743195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:19.746495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:19.747976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:19.755453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:19.793070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 54/106] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:04:19 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:19.793984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:19.853751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 53/107] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:19.893802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:19.962043 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb095cd-b07f-4fb2-b6c5-3160c78856d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.000061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f340e-dcf5-4d33-a669-bb1ed478343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.001034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f340e-dcf5-4d33-a669-bb1ed478343c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.001348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f340e-dcf5-4d33-a669-bb1ed478343c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.001625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f340e-dcf5-4d33-a669-bb1ed478343c None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.002914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f340e-dcf5-4d33-a669-bb1ed478343c None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:20.005201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f340e-dcf5-4d33-a669-bb1ed478343c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:20.007051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 55/108] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:19 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:20.011398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.012268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03eaa2-a76a-46e8-a895-8d3109eec664 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.012268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03eaa2-a76a-46e8-a895-8d3109eec664 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.012562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03eaa2-a76a-46e8-a895-8d3109eec664 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.013857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 56/109] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:20.015423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594992b-016d-4a9c-af68-d57c9960458b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.015888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594992b-016d-4a9c-af68-d57c9960458b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.016044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594992b-016d-4a9c-af68-d57c9960458b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.017327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 57/110] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:20.018059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594992b-016d-4a9c-af68-d57c9960458b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.063628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a1c43-06d8-4996-96f3-87e3035df3de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.095705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.114817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97db0d-6411-4ebb-bba5-ceefcbc66fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.115681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97db0d-6411-4ebb-bba5-ceefcbc66fff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.115978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97db0d-6411-4ebb-bba5-ceefcbc66fff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.116263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97db0d-6411-4ebb-bba5-ceefcbc66fff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.129253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97db0d-6411-4ebb-bba5-ceefcbc66fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7d97db0d-6411-4ebb-bba5-ceefcbc66fff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:20.138197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:20.139087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:20.139843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:20.140418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:20.141182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.141479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.141767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.152140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594992b-016d-4a9c-af68-d57c9960458b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.159213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:20.160412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:20.200762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210df87-e697-40bd-98e2-7af996e78a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.201166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210df87-e697-40bd-98e2-7af996e78a0d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.201517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210df87-e697-40bd-98e2-7af996e78a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.201810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210df87-e697-40bd-98e2-7af996e78a0d None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.203026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210df87-e697-40bd-98e2-7af996e78a0d None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:20.204528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210df87-e697-40bd-98e2-7af996e78a0d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:20.206536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 58/112] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:20.207558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.208200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.208200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.227564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:20.228687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:20.242475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 55/113] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:20.243645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.309896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 59/114] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:20.310595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.329056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.373593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d7b00-fb86-47e1-a27e-98c556dff50d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.385014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.413161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.413841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.414128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.414408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.415196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:20.415511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:20.417102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1493f-1626-43b1-88f4-fa0f12e96ea8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:20.427544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 56/115] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:20.428736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e32d-bf6c-4060-b2d4-641fefc74086 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.429031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e32d-bf6c-4060-b2d4-641fefc74086 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.429307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e32d-bf6c-4060-b2d4-641fefc74086 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.430657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 57/116] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:20.432985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d87d3-fc3b-4c51-bd9b-9fbda73c7e43 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.435229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e32d-bf6c-4060-b2d4-641fefc74086 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.469819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.470705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.470990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.471306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126/users/3d323dabd4b9465085858a1023b364cc/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.473235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=af097cba5b204232b159af38f2488126, user_id=3d323dabd4b9465085858a1023b364cc, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:20.474727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:20.490749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 60/117] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:20 2022] PUT /identity/v3/projects/af097cba5b204232b159af38f2488126/users/3d323dabd4b9465085858a1023b364cc/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:20.491513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.576605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e32d-bf6c-4060-b2d4-641fefc74086 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.608073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d2f08-c0d0-4853-9710-7c0697f8c5e0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.620487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.628834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.640489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.643178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.643810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.644559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.653414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07948c0a-0c62-4fab-9f3b-d1b99e2e6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.654240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948c0a-0c62-4fab-9f3b-d1b99e2e6b88 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.654524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948c0a-0c62-4fab-9f3b-d1b99e2e6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.654806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07948c0a-0c62-4fab-9f3b-d1b99e2e6b88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.661491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:20.670987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:20.672110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:20.672872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:20.673429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 58/118] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:20.674041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.674137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07948c0a-0c62-4fab-9f3b-d1b99e2e6b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-07948c0a-0c62-4fab-9f3b-d1b99e2e6b88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:20.683446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:20.684319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 61/119] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:20.685958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.687789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.687789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.712060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:20.713967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:20.786833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 62/120] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:20.792326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.830658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64523817-2e12-4e89-bb7a-58aef41c1d02 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.877841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.879288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.879722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.880141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.883318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:20.884940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:20.886752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 59/121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:20.887678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:20.916024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eb978-2bf7-4248-84f9-6a2e3df7414b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:20.924559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.956313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:20.959594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:20.960445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:20.960842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:20.961243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:20.962278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:20.962829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:20.965055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:20.977009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 63/122] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:20.978248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.013603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db2453-f327-44f8-bb1d-d0544648203a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.055585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.056195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.056492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.056781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.057549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:21.057870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.059372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.073171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 60/123] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.074039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.106929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941196-c465-4cb4-a8d0-9761495064cb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.154807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.155992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.156429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.156857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.168688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:21.177961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:21.179020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:21.180014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:21.182055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:21.183150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.195499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef86230-f908-4204-ac5d-0470f7fb444e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.209965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:21.216204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:21.233172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.234047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.234338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.234618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.235894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.237455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.239369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.245086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.296825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c118-2040-43fe-ad60-4ee53373f33f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.334666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.336007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.336403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.336794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] PATH_INFO: `/v3/users/16da60391ee64830b0501fbd892a8f5c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.352217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebea58-de1f-42ff-b068-082b4a65ab6d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.361937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] RBAC: Authorizing `identity:get_user(user_id=16da60391ee64830b0501fbd892a8f5c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.363701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.366306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/users/16da60391ee64830b0501fbd892a8f5c => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.372011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.393405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.394575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.395640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.396661 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.398710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.401148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.403992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 62/127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.405097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.458275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:21.480499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:21.500013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660d0b0-0c19-44e7-ac29-d96cf89a8570 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.519258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4aade-2a3c-43a9-a795-b40617c78cfa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.539732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.540508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.540893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.541242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.542393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:21.542854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.544394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.554160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 66/128] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.555025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.562815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.563815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.564155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.564539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126/users/3d323dabd4b9465085858a1023b364cc/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.566886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=af097cba5b204232b159af38f2488126, user_id=3d323dabd4b9465085858a1023b364cc, role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.568716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.586464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 63/129] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:21 2022] PUT /identity/v3/projects/af097cba5b204232b159af38f2488126/users/3d323dabd4b9465085858a1023b364cc/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:21.587855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.681189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a59a8-b03b-403c-baf2-b8ccc2ec8623 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.727312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.728290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.728821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.729278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.738538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043b175-e981-4f1c-a720-6c009f8f71c9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.750978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:21.754579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:21.787324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.788217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.788503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.788784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] PATH_INFO: `/v3/projects/37e909970ff94530b8c9f058918676cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.791160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] RBAC: Authorizing `identity:get_project(project_id=37e909970ff94530b8c9f058918676cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.792674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.795422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 64/130] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/projects/37e909970ff94530b8c9f058918676cd => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.795719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:21.857872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.859403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.911224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d779f-36af-4e82-9785-450c610eb631 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:21.961026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:21.961922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:21.962210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:21.962491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:21.964909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:21.966371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:21.969048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 65/131] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:21.974424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.023937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 67/132] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:22.024631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.066368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:22.109627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:22.148338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de24a1-3f62-480f-b50a-8442813ac43b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.165119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b09c5-988e-4c12-bd83-9a0e810059fc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.192083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38539b-b532-4262-8012-4363e0c35f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.194029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38539b-b532-4262-8012-4363e0c35f31 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.194468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38539b-b532-4262-8012-4363e0c35f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.194879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38539b-b532-4262-8012-4363e0c35f31 None admin] PATH_INFO: `/v3/projects/37e909970ff94530b8c9f058918676cd/users/3d323dabd4b9465085858a1023b364cc/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.197516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38539b-b532-4262-8012-4363e0c35f31 None admin] RBAC: Authorizing `identity:create_grant(project_id=37e909970ff94530b8c9f058918676cd, user_id=3d323dabd4b9465085858a1023b364cc, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.199264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38539b-b532-4262-8012-4363e0c35f31 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:22.201399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.202271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.202559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.202844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.204475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.206201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:22.208474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 68/133] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:22 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:22.209325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.217403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 66/134] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:21 2022] PUT /identity/v3/projects/37e909970ff94530b8c9f058918676cd/users/3d323dabd4b9465085858a1023b364cc/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:22.221129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e39582-1f11-45c1-bc29-ab5c8f07a136 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.221490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e39582-1f11-45c1-bc29-ab5c8f07a136 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.221783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e39582-1f11-45c1-bc29-ab5c8f07a136 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.223465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 67/135] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:22.228452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e39582-1f11-45c1-bc29-ab5c8f07a136 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.353023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b050e3-2ac1-477a-b070-42ad5627739f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.361623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e39582-1f11-45c1-bc29-ab5c8f07a136 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.370884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:22.381204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:22.419002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.419949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.420238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.420519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126/users/ba85a3628d384dd78869d3e23b87ec91/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.422016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c6d44-7806-4d5a-86ac-907b50c62254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.422905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c6d44-7806-4d5a-86ac-907b50c62254 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.423265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c6d44-7806-4d5a-86ac-907b50c62254 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.423546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c6d44-7806-4d5a-86ac-907b50c62254 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.425337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c6d44-7806-4d5a-86ac-907b50c62254 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.427092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c6d44-7806-4d5a-86ac-907b50c62254 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:22.428630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] RBAC: Authorizing `identity:create_grant(project_id=af097cba5b204232b159af38f2488126, user_id=ba85a3628d384dd78869d3e23b87ec91, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.430105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:22.433061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 69/136] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:22 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:22.436856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.437146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.437427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.454550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:22 2022] PUT /identity/v3/projects/af097cba5b204232b159af38f2488126/users/ba85a3628d384dd78869d3e23b87ec91/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:22.455524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.476399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:22.478066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:22.587176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:22.594798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3adc13-9c8e-4290-a9f5-a12835aea29f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.614104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.636975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.637663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.637954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.638237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.639246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] RBAC: Adding query filter params (role.id=8ed59d1d11a84143b47bc7b37433b0bb, scope.project.id=af097cba5b204232b159af38f2488126, user.id=16da60391ee64830b0501fbd892a8f5c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:22.639571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.641087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:22.647914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 69/139] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:22 2022] GET /identity/v3/role_assignments?user.id=16da60391ee64830b0501fbd892a8f5c&scope.project.id=af097cba5b204232b159af38f2488126&role.id=8ed59d1d11a84143b47bc7b37433b0bb => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:22.752619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35470fb4-71ec-44fa-ba0e-27af57ff5183 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.785498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:22.806514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee4372-d2c8-4e30-a2ed-559761dcce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.807377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4372-d2c8-4e30-a2ed-559761dcce14 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.807673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4372-d2c8-4e30-a2ed-559761dcce14 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.807965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee4372-d2c8-4e30-a2ed-559761dcce14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.811769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee4372-d2c8-4e30-a2ed-559761dcce14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.813246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee4372-d2c8-4e30-a2ed-559761dcce14 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:22.815214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 71/140] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:22.820718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:22.866372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:22.948340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3220e-b5f8-4dcd-a054-054fc900f879 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:22.990622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7964ca9-695c-45d1-95d3-89d806f494d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:22.991759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964ca9-695c-45d1-95d3-89d806f494d4 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:22.992266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964ca9-695c-45d1-95d3-89d806f494d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:22.992804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7964ca9-695c-45d1-95d3-89d806f494d4 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:22.994527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7964ca9-695c-45d1-95d3-89d806f494d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:22.996747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7964ca9-695c-45d1-95d3-89d806f494d4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:23.039874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 70/141] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:22 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:23.210384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8806f5-08e3-445c-bdf9-3620e0b6149b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:23.210878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8806f5-08e3-445c-bdf9-3620e0b6149b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:23.210878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8806f5-08e3-445c-bdf9-3620e0b6149b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:23.212281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 72/142] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:23.218015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:23.218479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:23.218574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:23.241119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:23.242331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:23.345513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:23.388510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8806f5-08e3-445c-bdf9-3620e0b6149b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:23.513286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8806f5-08e3-445c-bdf9-3620e0b6149b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:23.548062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:23.549260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:23.549836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:23.550326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:23.563730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:23.572653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:23.573532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:23.574346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:23.576403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 73/144] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:23.582371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:23.611455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:23.729143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a154b-fa36-4009-986b-4ab5e0062105 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:23.769282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:23.770182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:23.770622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:23.771101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:23.772099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:23.772552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:23.774153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:23.784721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 72/145] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:23.790185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:23.841256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:23.913795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2d1b-139f-4e0a-92c2-d221a7479560 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:23.957634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:23.958563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:23.958851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:23.959158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:23.960393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:23.961894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:23.963745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 74/146] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:23 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:23.970137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:24.119416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:24.163101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b8802-095b-46c9-82fe-c12d54eaf30e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:24.209283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:24.209941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:24.210230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:24.210503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:24.290398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:24.291948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:24.386557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:24.409405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:24.416632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:24.558730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965c9f-1fcb-477e-888e-06d7f9915e7f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:24.572511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:24.597339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e9eed-d69c-4166-8322-9dc345fae044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:24.598224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9eed-d69c-4166-8322-9dc345fae044 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:24.598513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9eed-d69c-4166-8322-9dc345fae044 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:24.598870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e9eed-d69c-4166-8322-9dc345fae044 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:24.600606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e9eed-d69c-4166-8322-9dc345fae044 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:24.602059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e9eed-d69c-4166-8322-9dc345fae044 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:24.603794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 75/148] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:24 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:24.609734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:24.765527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1be85-a283-432a-8f9b-969cceb7f4db None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:24.812659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:24.813332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:24.813620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:24.813900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:24.814738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=af097cba5b204232b159af38f2488126, user.id=3d323dabd4b9465085858a1023b364cc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:24.815066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:24.816545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b062f91-9952-4d69-848d-2dc0f3d7d083 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:24.828083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 74/149] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:24 2022] GET /identity/v3/role_assignments?user.id=3d323dabd4b9465085858a1023b364cc&scope.project.id=af097cba5b204232b159af38f2488126&role.id=bcc6944090e84b989e96027d0859ed4b => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:25.065091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e372-899d-475d-b7e4-8ea5924ef0fe None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.065397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e372-899d-475d-b7e4-8ea5924ef0fe None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.065669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268e372-899d-475d-b7e4-8ea5924ef0fe None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.067076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 76/150] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:25.073980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.074293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.074543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.095569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:25.096750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:25.146924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:25.168496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7918d-2628-4791-b11c-d6c38d217736 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.168829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7918d-2628-4791-b11c-d6c38d217736 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.169068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7918d-2628-4791-b11c-d6c38d217736 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.170440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 77/151] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:25.175926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.176218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.176501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.198433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 75/152] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:25.216160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:25.217386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:25.244582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:25.351397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 78/153] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:25.416232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a7fc9-0fb1-45ca-a784-7f48914e4106 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:25.447661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:25.496894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:25.498064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.498560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.499065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.516494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:25.539867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:25.540790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:25.541555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:25.544260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 76/154] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:25.562966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:25.621003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:25.658890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6fa0c-1d21-4568-9026-b7da793582fc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:25.670251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:25.715063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:25.715063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.715063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.715063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.732268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:25.746905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:25.747834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:25.748803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:25.752431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 79/155] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:25.761335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d490236-7696-4d4f-8680-bd57a36124c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:25.767776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:25.834070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:25.835152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:25.835642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:25.836211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:25.837232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:25.837817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:25.839506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:25.857007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 77/156] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:25.863247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:26.035397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:26.040000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d41730-1e06-4d39-8013-00d46f515cd0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:26.053581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5444421-7ae4-43db-85c3-79e7c90081cc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:26.128008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:26.128953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.129247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.129533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.130813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:26.132323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:26.133981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 78/157] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:25 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:26.137072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:26.137754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.138045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.138512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.139104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:26.139350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:26.139448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:26.140798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:26.158851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 80/158] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:26.166441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:26.243334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:26.374073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cee29-886a-4b0a-853a-f63598abaa92 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:26.409061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72746d6-ef05-47bf-956e-dec47cd3afea None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:26.438150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed882bf6-c045-4efa-85e6-35ceda967f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:26.439633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882bf6-c045-4efa-85e6-35ceda967f48 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.441263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882bf6-c045-4efa-85e6-35ceda967f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.441911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882bf6-c045-4efa-85e6-35ceda967f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.474861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109aaacc-5971-4f15-a94f-1275b583a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:26.477150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aaacc-5971-4f15-a94f-1275b583a309 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.477783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aaacc-5971-4f15-a94f-1275b583a309 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.479412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109aaacc-5971-4f15-a94f-1275b583a309 None admin] PATH_INFO: `/v3/users/3d323dabd4b9465085858a1023b364cc` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.481723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aaacc-5971-4f15-a94f-1275b583a309 None admin] RBAC: Authorizing `identity:get_user(user_id=3d323dabd4b9465085858a1023b364cc)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:26.485768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109aaacc-5971-4f15-a94f-1275b583a309 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:26.487632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 81/159] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:26 2022] GET /identity/v3/users/3d323dabd4b9465085858a1023b364cc => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:26.489296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629a5f-21d8-47a7-8493-c7ce84fe4967 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.490825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629a5f-21d8-47a7-8493-c7ce84fe4967 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.491484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff629a5f-21d8-47a7-8493-c7ce84fe4967 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.494389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 82/160] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:26.496547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514c0c-322c-419e-bf76-808b1f29aa1b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.497663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514c0c-322c-419e-bf76-808b1f29aa1b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.498307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514c0c-322c-419e-bf76-808b1f29aa1b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.501940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 83/161] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:26.503480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514c0c-322c-419e-bf76-808b1f29aa1b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:26.506097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:26.576278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882bf6-c045-4efa-85e6-35ceda967f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:26.578108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882bf6-c045-4efa-85e6-35ceda967f48 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:26.702320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:26.720321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:04:26.721936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44dec5-33f0-40a9-b2e6-dfdda96b3787 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.722429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44dec5-33f0-40a9-b2e6-dfdda96b3787 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.722961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44dec5-33f0-40a9-b2e6-dfdda96b3787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.723713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514c0c-322c-419e-bf76-808b1f29aa1b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:26.741029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-af44dec5-33f0-40a9-b2e6-dfdda96b3787 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:26.742515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af44dec5-33f0-40a9-b2e6-dfdda96b3787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:26.806833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:26.815861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:26.816537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.816823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.817105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.821181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 80/163] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:26.822719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:26.823257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:26.823739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:26.841499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:26.843110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:26.919902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 81/164] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:26.921256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.027908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.029408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.041371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484efa36-7258-4235-bbbf-1bfcb77e1d06 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.068619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.082942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.084748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.085286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.085763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] PATH_INFO: `/v3/projects/37e909970ff94530b8c9f058918676cd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.087301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] RBAC: Authorizing `identity:get_project(project_id=37e909970ff94530b8c9f058918676cd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.089049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.091215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 82/165] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:26 2022] GET /identity/v3/projects/37e909970ff94530b8c9f058918676cd => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:27.092181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.208139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecea21-eddb-455e-90f7-87755afe32fc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.242704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.247256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 84/166] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:27.247960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.248925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.249970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.250614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.251817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.264628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:27.274098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:27.274957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:27.276055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:27.278773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:27.279796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.336286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.362209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d8fe2-3d63-4f45-bfa5-a1887e12f3d2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.399762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c2bb3-2769-49ad-85a5-206efe68eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.400376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6276e7-dcae-4c42-ba9c-efd02d318d86 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.400556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2bb3-2769-49ad-85a5-206efe68eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.400847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2bb3-2769-49ad-85a5-206efe68eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.401129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c2bb3-2769-49ad-85a5-206efe68eaa2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.411890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c2bb3-2769-49ad-85a5-206efe68eaa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bd0c2bb3-2769-49ad-85a5-206efe68eaa2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:27.419611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:27.420492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:27.421282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:27.422023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606daad-8251-4916-9fc2-a67d2060f1d1 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.422852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606daad-8251-4916-9fc2-a67d2060f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.422852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606daad-8251-4916-9fc2-a67d2060f1d1 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.424763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 86/169] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:27.424763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606daad-8251-4916-9fc2-a67d2060f1d1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.448597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.449243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.449530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.449810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.450651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=37e909970ff94530b8c9f058918676cd, user.id=3d323dabd4b9465085858a1023b364cc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:27.450970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.452451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.458791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 84/170] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/role_assignments?user.id=3d323dabd4b9465085858a1023b364cc&scope.project.id=37e909970ff94530b8c9f058918676cd&role.id=bcc6944090e84b989e96027d0859ed4b => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:27.468108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.496139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.548862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606daad-8251-4916-9fc2-a67d2060f1d1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.589548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b95c88-2467-457d-a15b-5bfedba05054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.591186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b95c88-2467-457d-a15b-5bfedba05054 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.591186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b95c88-2467-457d-a15b-5bfedba05054 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.591186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b95c88-2467-457d-a15b-5bfedba05054 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.592335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b95c88-2467-457d-a15b-5bfedba05054 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.594013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b95c88-2467-457d-a15b-5bfedba05054 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.595935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:27.597319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc0ef-1b86-4e6d-a150-16c9e7848181 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.597606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc0ef-1b86-4e6d-a150-16c9e7848181 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.598463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbc0ef-1b86-4e6d-a150-16c9e7848181 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.599299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 88/172] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:27.603857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc0ef-1b86-4e6d-a150-16c9e7848181 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.638225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098472c-e554-46f7-8d94-b3f82f185890 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.653378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.678897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.679172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.679466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.679747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.680507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:27.680820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.682972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8888774-6949-470b-95d5-0d20dc16c37f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.692773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 85/173] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:27.695736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.696034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.696304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.716906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:27.718113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:27.738122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbc0ef-1b86-4e6d-a150-16c9e7848181 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.764507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.773879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.774542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.774827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.775138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.775879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:27.776189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.777557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d338899-75a1-40e0-9c8c-732ee357a07b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.784415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:27.785134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.790599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 89/175] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:27.790599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795553f9-ca0f-416d-a9d2-e5e6cbc01723 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.790599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795553f9-ca0f-416d-a9d2-e5e6cbc01723 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.790599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795553f9-ca0f-416d-a9d2-e5e6cbc01723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.804963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-795553f9-ca0f-416d-a9d2-e5e6cbc01723 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:27.806128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-795553f9-ca0f-416d-a9d2-e5e6cbc01723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:27.871923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 90/176] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:27.873496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a35ea-49c3-450a-8835-7a1f5c1c0339 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.873790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a35ea-49c3-450a-8835-7a1f5c1c0339 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.874079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a35ea-49c3-450a-8835-7a1f5c1c0339 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.879074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 91/177] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:27.879074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a35ea-49c3-450a-8835-7a1f5c1c0339 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:27.898726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6e2f1-627f-40b0-9aed-e5f29dd7e5ef None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:27.906120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:27.934028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:27.934683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:27.934972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:27.935286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:27.936115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] RBAC: Adding query filter params (role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=af097cba5b204232b159af38f2488126, user.id=3d323dabd4b9465085858a1023b364cc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:27.936435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:27.937879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:27.943735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 87/178] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/role_assignments?user.id=3d323dabd4b9465085858a1023b364cc&scope.project.id=af097cba5b204232b159af38f2488126&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:27.944354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.002991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a35ea-49c3-450a-8835-7a1f5c1c0339 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.025230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.045637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.046538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.046835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.047323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] PATH_INFO: `/v3/users/ba85a3628d384dd78869d3e23b87ec91` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.048410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ba85a3628d384dd78869d3e23b87ec91)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.049917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.057106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 92/179] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/users/ba85a3628d384dd78869d3e23b87ec91 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.057106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.070699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafa7d-60fe-437b-8c26-e4beaeeb9b78 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.112858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b8571-5bb8-44eb-9e70-9f7fc2aeffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.113742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8571-5bb8-44eb-9e70-9f7fc2aeffbd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.114025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8571-5bb8-44eb-9e70-9f7fc2aeffbd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.114303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8571-5bb8-44eb-9e70-9f7fc2aeffbd None admin] PATH_INFO: `/v3/users/16da60391ee64830b0501fbd892a8f5c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.116909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b8571-5bb8-44eb-9e70-9f7fc2aeffbd None admin] RBAC: Authorizing `identity:get_user(user_id=16da60391ee64830b0501fbd892a8f5c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.117941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b8571-5bb8-44eb-9e70-9f7fc2aeffbd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.123196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 88/180] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:27 2022] GET /identity/v3/users/16da60391ee64830b0501fbd892a8f5c => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.124447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.124745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.125031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.143903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:28.145078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:28.179001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.181452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3638a-3c25-48ba-846a-5e4b24dec7c9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.215818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 89/181] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:28.216729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.219293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.220094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.220385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.220664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.232438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:28.240291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:28.241350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 93/182] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:28.242331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.289991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.318114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b01fb5-e707-49e3-afae-cfc33c313e3a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.343191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025de221-f3ba-41c8-8034-bb63e9018b37 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.351888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.352690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.352974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.353250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.363075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:28.371136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:28.371992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:28.372781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 90/183] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:28.373419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.379924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.380598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.380883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.381167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.402355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.449141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.450618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.474941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6057d-9f7f-4679-866d-f67632eb0074 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.496029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.509617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.510491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.510774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.511061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.512255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.513709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.515434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 91/184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.516261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.550189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 94/185] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:28.551014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.616039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.622080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128b02-f5fd-41c9-95d2-34096feeb894 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.649617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b6762-a773-4f97-b7b7-99334518fe02 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.655234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.656033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.656321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.656609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.657771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.659246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.660850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 92/186] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.663982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.683268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.683938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.684229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.684510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.685262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:28.685600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.686981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.700307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 95/187] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.700307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.706927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.764535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432df30e-6dde-4394-a704-d4ab4dab6193 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.795613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a2dc3-884e-421b-80be-f95eee67c72c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.797501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.798161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.798602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.798884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.799658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:28.799965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.801328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.809287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 93/188] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.810052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.834643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.835577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.835862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.836140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126/users/16da60391ee64830b0501fbd892a8f5c/roles/8ed59d1d11a84143b47bc7b37433b0bb` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.837172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.838161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] RBAC: Authorizing `identity:create_grant(project_id=af097cba5b204232b159af38f2488126, user_id=16da60391ee64830b0501fbd892a8f5c, role_id=8ed59d1d11a84143b47bc7b37433b0bb)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.839865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.851966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 96/189] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:28 2022] PUT /identity/v3/projects/af097cba5b204232b159af38f2488126/users/16da60391ee64830b0501fbd892a8f5c/roles/8ed59d1d11a84143b47bc7b37433b0bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:28.863361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.920426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f648b-8618-4334-b659-641581850d02 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:28.935834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:28.961825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:28.962823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:28.963250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:28.963635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:28.965005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:28.966628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:28.968880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 94/190] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:28.969899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:28.984864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8210301-cb5a-4fd0-b2b7-0d88cf0c9bca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:29.032843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:29.033555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:29.033846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:29.034130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:29.034852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:29.036332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:29.058309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 97/191] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:28 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:29.059525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:29.105708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:29.114332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31d204-0503-4dec-be88-1e0b0ec1797c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:29.183375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:29.184215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:29.184560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:29.184782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] PATH_INFO: `/v3/users/17957af4b7294da6bc63f6b61715c225` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:29.192574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31888c00-614e-4eff-b189-9a0bd6d59012 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:29.216109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] RBAC: Authorizing `identity:get_user(user_id=17957af4b7294da6bc63f6b61715c225)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:29.217649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:29.223925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 95/192] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:28 2022] GET /identity/v3/users/17957af4b7294da6bc63f6b61715c225 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:29.223925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:29.228167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:29.241647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:29.243142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:29.244089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:29.244569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] PATH_INFO: `/v3/users/17957af4b7294da6bc63f6b61715c225` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:29.246044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] RBAC: Authorizing `identity:get_user(user_id=17957af4b7294da6bc63f6b61715c225)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:29.248955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:29.251029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 98/193] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:29 2022] GET /identity/v3/users/17957af4b7294da6bc63f6b61715c225 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:29.252123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:29.378726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8dfa1e-d562-4f49-9e60-23f33afbceab None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:29.442935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:29.444128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:29.444489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:29.444845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:29.445944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=af097cba5b204232b159af38f2488126, user.id=ba85a3628d384dd78869d3e23b87ec91) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:29.456526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:29.457561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:29.460256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318b4b-c626-4e88-b2e7-3113f22096c9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:29.470848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 96/194] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:29 2022] GET /identity/v3/role_assignments?user.id=ba85a3628d384dd78869d3e23b87ec91&scope.project.id=af097cba5b204232b159af38f2488126&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:29.471142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:29.499967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:29.528330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:29.529633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:29.530033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:29.530567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:29.653427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:29.673452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:29.674976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:29.682221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150a744-5c14-4690-8889-6aa5d8f360f7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:29.776023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:29.776747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:29.777041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:29.777324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:29.823815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 99/195] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:29.835943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:29.914705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:29.916231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:29.937206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:29.972249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:29.988285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a11c6-cc82-45a8-8e23-09e96c151163 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:30.045429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:30.046235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:30.046523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:30.046805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:30.051792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:30.053551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:30.055501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 100/196] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:29 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:30.061162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:30.075227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 97/197] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:30.077523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:30.206155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132039c-58d4-4cb3-a6e2-27625d8556a6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:30.225266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:30.250030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:30.256555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:30.256843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:30.257124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:30.258370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:30.259865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:30.263995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 98/198] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:30 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:30.269524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:30.317120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67beb09f-44cc-457e-a3b4-9ed795a01245 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:30.394873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f38af9-fc10-4881-8190-4d45904ab75d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:30.412661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:30.413633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:30.414153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:30.414623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:30.415681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=17957af4b7294da6bc63f6b61715c225) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:30.416286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:30.417922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17b23a-6bcc-4b3f-a030-b64d4e7213f2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:30.424367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 101/199] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:30 2022] GET /identity/v3/role_assignments?user.id=17957af4b7294da6bc63f6b61715c225&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:30.434913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:30.435975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:30.436471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:30.436937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:30.437973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] RBAC: Adding query filter params (role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=17957af4b7294da6bc63f6b61715c225) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:30.438480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:30.440162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf967cef-c042-4605-a607-a3974c7b5d85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:30.447405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 99/200] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:30 2022] GET /identity/v3/role_assignments?user.id=17957af4b7294da6bc63f6b61715c225&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:31.130993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749f9fb-0cbe-4f45-9360-04d70494e0bf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:31.132037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749f9fb-0cbe-4f45-9360-04d70494e0bf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:31.132522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749f9fb-0cbe-4f45-9360-04d70494e0bf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:31.134123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 102/201] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:31.139473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:31.140262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:31.140737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:31.167989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:31.169603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:31.224702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:31.253483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 100/202] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:31.290214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749f9fb-0cbe-4f45-9360-04d70494e0bf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:31.317921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:31.416375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749f9fb-0cbe-4f45-9360-04d70494e0bf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:31.470055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:31.470855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:31.471167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:31.471451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:31.489052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:31.496938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:31.497913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:31.498694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 103/203] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:31.507900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:31.611250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d243204-a0d9-44c1-a345-54df2c75ba2a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:31.646492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:31.647203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:31.647490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:31.647769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:31.648517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:31.648821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:31.650216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:31.658738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 101/204] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:31.664395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:31.773272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:31.793552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda9f7e-a268-4de6-9c43-4e8f5836df64 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:31.847938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acada88d-f044-4e2a-9ba0-c9ce5b07812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:31.848859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada88d-f044-4e2a-9ba0-c9ce5b07812a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:31.849184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada88d-f044-4e2a-9ba0-c9ce5b07812a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:31.849467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acada88d-f044-4e2a-9ba0-c9ce5b07812a None admin] PATH_INFO: `/v3/users/16da60391ee64830b0501fbd892a8f5c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:31.850903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acada88d-f044-4e2a-9ba0-c9ce5b07812a None admin] RBAC: Authorizing `identity:get_user(user_id=16da60391ee64830b0501fbd892a8f5c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:31.852473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acada88d-f044-4e2a-9ba0-c9ce5b07812a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:31.854479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 104/205] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:31 2022] GET /identity/v3/users/16da60391ee64830b0501fbd892a8f5c => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:31.859979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:31.907432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:31.967876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588756-fbd7-4ffa-9699-c0c08e35574c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.002414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.003090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.003378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.004076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.073127 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:32.074760 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:32.095189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768a0e4-4113-4375-8d71-959e4d8c9b28 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.095483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768a0e4-4113-4375-8d71-959e4d8c9b28 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.095767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768a0e4-4113-4375-8d71-959e4d8c9b28 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.097138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 105/206] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:32.103536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.103821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.104102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.129470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:32.130673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:32.147356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:32.256188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 106/207] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:32.266081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 102/208] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:32.271899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.309185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.365452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:32.387951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635ed94-697f-4bc2-bf2e-eee6bba562cb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.412943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d34f-23bb-4194-b933-f5e484b55651 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.427234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0ac2a-8c9e-43f6-9c51-60dde11dc999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.428480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ac2a-8c9e-43f6-9c51-60dde11dc999 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.429003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ac2a-8c9e-43f6-9c51-60dde11dc999 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.429479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ac2a-8c9e-43f6-9c51-60dde11dc999 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.431112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0ac2a-8c9e-43f6-9c51-60dde11dc999 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:32.432752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0ac2a-8c9e-43f6-9c51-60dde11dc999 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:32.435160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 107/209] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:32.436675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9aeb9-4d3c-4fd5-970c-064e48e0a37b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.437173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9aeb9-4d3c-4fd5-970c-064e48e0a37b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.437647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9aeb9-4d3c-4fd5-970c-064e48e0a37b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.439349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 108/210] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:32.440503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9aeb9-4d3c-4fd5-970c-064e48e0a37b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.453357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06662dca-00d6-44cb-b314-f08a89f4cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.454155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06662dca-00d6-44cb-b314-f08a89f4cb55 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.454436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06662dca-00d6-44cb-b314-f08a89f4cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.454710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06662dca-00d6-44cb-b314-f08a89f4cb55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.463569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:32.466583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06662dca-00d6-44cb-b314-f08a89f4cb55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-06662dca-00d6-44cb-b314-f08a89f4cb55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:32.475432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:32.476517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:32.477498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:32.480131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 103/211] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:32.486030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.486428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.486811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.504964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:32.506310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:32.573086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9aeb9-4d3c-4fd5-970c-064e48e0a37b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.579336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 104/212] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:32.580416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.611106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.612100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.612605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.613087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.614135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] RBAC: Adding query filter params (role.id=8ed59d1d11a84143b47bc7b37433b0bb, scope.project.id=af097cba5b204232b159af38f2488126, user.id=16da60391ee64830b0501fbd892a8f5c) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:32.615258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:32.617438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:32.624353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 109/213] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/role_assignments?user.id=16da60391ee64830b0501fbd892a8f5c&scope.project.id=af097cba5b204232b159af38f2488126&role.id=8ed59d1d11a84143b47bc7b37433b0bb => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:32.625524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.643959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:32.690478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3180e9-0de0-4595-8e6e-6d9658c6fdf6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.725967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:32.733061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.734383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.734383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.734854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.736040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:32.736473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:32.738016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:32.747665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 105/214] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:32.752796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb38caf-fb00-43ca-a61d-96be29834078 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.753421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.793732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.794814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.795307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.795746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.797180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:32.799016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:32.801227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 110/215] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:32.808190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.865522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ea503-4a28-4b53-b1cd-4f73c5e3af83 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:32.902346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce47b2-7975-4b4c-b6ef-6ea46cb9a296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:32.903388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce47b2-7975-4b4c-b6ef-6ea46cb9a296 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.903907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce47b2-7975-4b4c-b6ef-6ea46cb9a296 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.904138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce47b2-7975-4b4c-b6ef-6ea46cb9a296 None admin] PATH_INFO: `/v3/users/8ac4878a26464e77b69de556c60c9815` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.920436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce47b2-7975-4b4c-b6ef-6ea46cb9a296 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac4878a26464e77b69de556c60c9815)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:32.922096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce47b2-7975-4b4c-b6ef-6ea46cb9a296 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:32.924480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 106/216] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/users/8ac4878a26464e77b69de556c60c9815 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:32.925576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6489f-b472-4c6f-8e65-b2d885dd2220 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:32.930794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6489f-b472-4c6f-8e65-b2d885dd2220 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:32.931236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6489f-b472-4c6f-8e65-b2d885dd2220 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:32.933273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 107/217] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:32.934236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6489f-b472-4c6f-8e65-b2d885dd2220 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:32.950069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:32.977589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562067f-1932-4ebb-8aa2-92ac5d9e8f2e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.004253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.024062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf60666-b7e8-4b63-a69c-a96b138483cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.025787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60666-b7e8-4b63-a69c-a96b138483cf None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.026232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60666-b7e8-4b63-a69c-a96b138483cf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.027320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60666-b7e8-4b63-a69c-a96b138483cf None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.028019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf60666-b7e8-4b63-a69c-a96b138483cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:33.029466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf60666-b7e8-4b63-a69c-a96b138483cf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:33.053743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 111/218] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:32 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:33.056471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08b59-00ce-416e-b368-b71f4993a18f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.056777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08b59-00ce-416e-b368-b71f4993a18f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.057063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f08b59-00ce-416e-b368-b71f4993a18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.066478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6489f-b472-4c6f-8e65-b2d885dd2220 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.076974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-31f08b59-00ce-416e-b368-b71f4993a18f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:33.078161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-31f08b59-00ce-416e-b368-b71f4993a18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:33.108038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.108738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.109027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.109309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.156756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 112/219] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:33.158462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab67e-262d-4294-80fe-cc773e04a956 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.158757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab67e-262d-4294-80fe-cc773e04a956 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.159066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab67e-262d-4294-80fe-cc773e04a956 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.160425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 113/220] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:33.172277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.172277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.172277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.189102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:33.190307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:33.196584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:33.198091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:33.257070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.272589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.282339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 114/221] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:33.283577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.317525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 108/222] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:33.318924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.402267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33a1d3-adaa-4dec-9a54-e0108c0413d8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.444596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc23a1-3e4c-43b7-aa04-926cb8ea3b46 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.448214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.449274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.449762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.450261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.468167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:33.477868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:33.478785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:33.479666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:33.481562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 115/223] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:33.485971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.486088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.488626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.488925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.489208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.501601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:33.511713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:33.512611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:33.513428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:33.515115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 109/224] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:33.517128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.532532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.559388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.614335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66f1e-01d6-44e9-9a87-e0e850c60617 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.627366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e8044-f48f-4492-8e44-54ae4b15d41b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.651542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.652526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.652825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.653111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.654445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:33.656069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:33.658035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 116/225] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:33.658810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.664343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.665021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.665311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.665598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.666362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:33.666674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:33.668108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:33.677301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 110/226] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:33.678035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.752205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.777893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79abc65-0e0c-4921-be7f-3c5ec5d45603 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.789629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cce814-2ae1-4cbb-bebc-2ce136399039 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:33.805658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:33.816176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.817141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.818122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.818585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.819568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:33.819887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:33.821299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:33.829994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 117/227] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:33.830644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:33.841387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:33.842835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:33.843372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:33.844268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:33.845609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=8ac4878a26464e77b69de556c60c9815) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:33.846126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:33.848618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:33.857065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 111/228] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/role_assignments?user.id=8ac4878a26464e77b69de556c60c9815&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=bcc6944090e84b989e96027d0859ed4b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:33.858082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:34.011283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de088d51-d702-46fd-86fd-bbe921c69b5e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:34.046252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2307-a3b9-4421-a756-de7d839a888a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:34.054529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:34.055785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:34.056293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:34.056769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] PATH_INFO: `/v3/users/17957af4b7294da6bc63f6b61715c225` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:34.058241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] RBAC: Authorizing `identity:get_user(user_id=17957af4b7294da6bc63f6b61715c225)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:34.059966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:34.062056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 118/229] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/users/17957af4b7294da6bc63f6b61715c225 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:34.068228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:34.104397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:34.106899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:34.107255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:34.107664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] PATH_INFO: `/v3/users/17957af4b7294da6bc63f6b61715c225` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:34.108914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] RBAC: Authorizing `identity:get_user(user_id=17957af4b7294da6bc63f6b61715c225)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:34.110676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:34.113430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 112/230] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:33 2022] GET /identity/v3/users/17957af4b7294da6bc63f6b61715c225 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:34.119335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:34.124811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:34.139153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:34.219093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9182b-48e4-4172-b89e-27d7ddebfea4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:34.256521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:34.257649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:34.258103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:34.258523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:34.259887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:34.262001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:34.264252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 119/231] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:34 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:34.269448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:34.329418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd2ad9-a0a2-46ce-a602-9d3ae28a07dc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:34.390361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889140b-5170-4422-89c5-7dfb7e9e9810 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:34.418057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:34.430665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27398cf2-8db6-4438-8704-672d2f3da688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:34.431563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:34.432074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27398cf2-8db6-4438-8704-672d2f3da688 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:34.432456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:34.432750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:34.432954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27398cf2-8db6-4438-8704-672d2f3da688 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:34.433062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:34.433535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27398cf2-8db6-4438-8704-672d2f3da688 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/17957af4b7294da6bc63f6b61715c225/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:34.435782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27398cf2-8db6-4438-8704-672d2f3da688 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f8bcbe7c20482ea2f11baadd886fe4, user_id=17957af4b7294da6bc63f6b61715c225, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:34.437495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27398cf2-8db6-4438-8704-672d2f3da688 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:34.439768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:34.441396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:34.448227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 113/232] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:34 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:34.452362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:34.461734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 120/233] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:34 2022] PUT /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/17957af4b7294da6bc63f6b61715c225/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:34.558536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:34.602270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a4317-42ff-47fe-97b8-a66335a30ef2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:34.650530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ceb9f-28c9-44bc-9bd6-b21bd2a83d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:34.651850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ceb9f-28c9-44bc-9bd6-b21bd2a83d8f None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:34.652343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ceb9f-28c9-44bc-9bd6-b21bd2a83d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:34.652823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ceb9f-28c9-44bc-9bd6-b21bd2a83d8f None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/17957af4b7294da6bc63f6b61715c225/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:34.661172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ceb9f-28c9-44bc-9bd6-b21bd2a83d8f None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f8bcbe7c20482ea2f11baadd886fe4, user_id=17957af4b7294da6bc63f6b61715c225, role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:34.663586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ceb9f-28c9-44bc-9bd6-b21bd2a83d8f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:34.697635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 114/234] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:34 2022] PUT /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/17957af4b7294da6bc63f6b61715c225/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:35.363710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac7134-876f-4b4b-8e57-e6eea96181d8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:35.364427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac7134-876f-4b4b-8e57-e6eea96181d8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:35.364947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac7134-876f-4b4b-8e57-e6eea96181d8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:35.366526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 121/235] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:35.371646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879534-136d-471c-91b2-df65486054ef None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:35.372479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879534-136d-471c-91b2-df65486054ef None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:35.372975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879534-136d-471c-91b2-df65486054ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:35.393342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-00879534-136d-471c-91b2-df65486054ef None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:35.394858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-00879534-136d-471c-91b2-df65486054ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:35.465823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 115/236] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:35.509962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac7134-876f-4b4b-8e57-e6eea96181d8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:35.648491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac7134-876f-4b4b-8e57-e6eea96181d8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:35.657124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca486d4d-7b2e-44a6-ba11-56682c87bcec None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:35.657423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca486d4d-7b2e-44a6-ba11-56682c87bcec None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:35.657707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca486d4d-7b2e-44a6-ba11-56682c87bcec None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:35.659274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 116/237] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:35.666356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:35.666649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:35.666932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:35.695486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:35.696299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:35.696589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:35.696867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:35.699728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:35.703660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:35.722496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:35.733376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:35.734256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:35.735280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 122/238] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:35.741989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:35.815409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:35.826571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:35.835726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 117/239] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:35.909137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:35.912170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849258b3-f6ea-4a19-9008-70ea1be143ba None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:35.949481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:35.950159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:35.950449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:35.950734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:35.951517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:35.951834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:35.953220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:35.972008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 123/240] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:35.980016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.071555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada8d9-7392-4ee6-b7ac-58b34eb7ceb8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.120559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18bafd-79f3-4b4e-b1cb-9587b3b87336 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.127867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:36.137343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:36.138153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.138444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.138725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.141593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:36.143071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:36.144916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 118/241] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:36.150781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.176421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:36.178138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.178428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.178709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] PATH_INFO: `/v3/users/bf29025dc34f4af0bed2839e36f17e8d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.210253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] RBAC: Authorizing `identity:get_user(user_id=bf29025dc34f4af0bed2839e36f17e8d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:36.211754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:36.216375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 124/242] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:35 2022] GET /identity/v3/users/bf29025dc34f4af0bed2839e36f17e8d => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:36.236593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.263425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:36.311482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5870888-0586-467b-a38a-f7d6cf63e510 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.354730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee2ce-8ea7-4909-bdcd-3be252eca094 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.357009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a39b5-db99-4d17-ad2c-81ef6a089f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:36.358494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a39b5-db99-4d17-ad2c-81ef6a089f1f None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.358786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a39b5-db99-4d17-ad2c-81ef6a089f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.359094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a39b5-db99-4d17-ad2c-81ef6a089f1f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.359873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a39b5-db99-4d17-ad2c-81ef6a089f1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:36.361338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a39b5-db99-4d17-ad2c-81ef6a089f1f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:36.389582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 119/243] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:36 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:36.391016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64569-d351-46bf-a428-6caf8c10fdb0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.391491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64569-d351-46bf-a428-6caf8c10fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.391916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64569-d351-46bf-a428-6caf8c10fdb0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.393693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 120/244] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:36.401425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.401975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.402417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.413863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:36.414534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.414821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.415128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.422584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:36.424173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:36.499367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:36.509062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 121/245] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:36.562187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:36.564341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:36.570817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.655019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:36.696133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 125/246] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:36.702071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.731557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acb2d2-42ee-42d7-a041-6abb206efbc1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.784480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:36.785222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.785510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.785788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.791403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:36.799916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:36.809185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:36.810207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:36.811283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:36.813803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 122/247] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:36.821263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.853672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4242ba-e6a7-4d59-b552-7f24ad140403 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.902132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:36.903538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:36.904027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:36.905011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:36.906876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:36.908911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:36.912030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 126/248] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:36 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:36.920665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:36.950772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cb1fc-e20d-48d4-9f46-ad9e7f8ede85 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:36.968107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:37.003677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.004533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.004891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.005865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.006698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:37.007157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:37.008905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:37.019529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 123/249] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:37.025466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.052770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573a492-a2e4-4857-abdb-248370dbfefb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.093161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:37.100770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.101447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.101755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.102013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.102955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] RBAC: Adding query filter params (role.id=8ed59d1d11a84143b47bc7b37433b0bb, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=bf29025dc34f4af0bed2839e36f17e8d) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:37.103329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:37.104996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178ea2c-e400-40b4-b4c9-910ef931cbf8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:37.111715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 127/250] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:36 2022] GET /identity/v3/role_assignments?user.id=bf29025dc34f4af0bed2839e36f17e8d&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=8ed59d1d11a84143b47bc7b37433b0bb => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:37.113094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149745a-5f96-4648-88c6-8c915e4b8c6a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.113386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149745a-5f96-4648-88c6-8c915e4b8c6a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.113664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149745a-5f96-4648-88c6-8c915e4b8c6a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.115808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 128/251] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:37.122145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.122440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.123072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.159432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:37.160864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:37.172091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0250d9-5357-460c-806d-b1be006e45ed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.213436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.214360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.214649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.214930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] PATH_INFO: `/v3/users/8ac4878a26464e77b69de556c60c9815` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.216552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac4878a26464e77b69de556c60c9815)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:37.218289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:37.220340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 124/252] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:37 2022] GET /identity/v3/users/8ac4878a26464e77b69de556c60c9815 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:37.226629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.268202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:37.342298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bee37-727b-4781-a253-ecfeea752429 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.356757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 129/253] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:37.381843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.382731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.383014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.383324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.384590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:37.386076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:37.391365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 125/254] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:37 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:37.393856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.401359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.543321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aa8b8-29ce-4faf-a8c6-bb6fa5482fe1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.573868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550301a-6040-4fcd-8a22-6f3cfb8ad085 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.578235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:37.591894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:37.611159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f8f1a-81ad-42b8-a57b-7cdad25836c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.612004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8f1a-81ad-42b8-a57b-7cdad25836c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.612292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8f1a-81ad-42b8-a57b-7cdad25836c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.612573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f8f1a-81ad-42b8-a57b-7cdad25836c5 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/8ac4878a26464e77b69de556c60c9815/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.616515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f8f1a-81ad-42b8-a57b-7cdad25836c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f8bcbe7c20482ea2f11baadd886fe4, user_id=8ac4878a26464e77b69de556c60c9815, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:37.618012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f8f1a-81ad-42b8-a57b-7cdad25836c5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:37.639698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 130/255] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:37 2022] PUT /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/8ac4878a26464e77b69de556c60c9815/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:37.641239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.641600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aaafe-0972-4f0c-bcc7-d9670333401a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.642064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.642310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aaafe-0972-4f0c-bcc7-d9670333401a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.642410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.642657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.643128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aaafe-0972-4f0c-bcc7-d9670333401a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.644758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 131/256] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:37.655578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:37.656882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.657281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.657665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:37.668560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:37.669515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:37.670324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:37.673555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 126/257] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:37.680139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.689337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:37.692221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:37.788804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 132/258] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:37.828514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.899571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a32985-f64e-4214-baa7-d49581a0e829 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.955763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:37.956747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:37.957206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:37.957682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:37.959197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:37.959697 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:37.961267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:37.970244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 127/259] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:37.976641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:37.979282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1939adb-747d-46a1-b1c3-ddfe5dfb8cc2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:37.997652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:38.047381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:38.047747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:38.048589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:38.048883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:38.049166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:38.071965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:38.088232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:38.089162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:38.089973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 133/260] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:38.095315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:38.128377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c7106-b4c9-4f17-862f-81421812a789 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:38.182593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:38.183439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:38.183722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:38.183997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] PATH_INFO: `/v3/users/17957af4b7294da6bc63f6b61715c225` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:38.187756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] RBAC: Authorizing `identity:get_user(user_id=17957af4b7294da6bc63f6b61715c225)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:38.189235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:38.190862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 128/261] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:37 2022] GET /identity/v3/users/17957af4b7294da6bc63f6b61715c225 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:38.200915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:38.299214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89766e65-42e0-49be-a912-cf625e857b59 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:38.335027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:38.335730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:38.336022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:38.336302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:38.337051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:38.337362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:38.338766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:38.347368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 134/262] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:38.352306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:38.353521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:38.362603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8a64-1884-467e-a876-8ee5d664c984 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:38.423680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:38.435317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:38.436638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:38.437144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:38.437619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:38.520005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89114b-fb3a-4c33-a705-9d961528813a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:38.572732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:38.574564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:38.575321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:38.576209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:38.576493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:38.576770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] PATH_INFO: `/v3/users/17957af4b7294da6bc63f6b61715c225` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:38.584337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] RBAC: Authorizing `identity:get_user(user_id=17957af4b7294da6bc63f6b61715c225)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:38.585786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:38.587844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 135/263] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:38 2022] GET /identity/v3/users/17957af4b7294da6bc63f6b61715c225 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:38.593168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:38.756042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:38.768022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 129/264] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:04:38.773972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:38.793665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184049c4-0409-4cd3-aedb-29965f7892c9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:38.806610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:38.851294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:38.851957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:38.852247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:38.852529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:38.962589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:38.964089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:38.980269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be329ebc-5ae0-4822-b52d-6322de663e0d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:39.069163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:39.070056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:39.070348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:39.070632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:39.071877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:39.073348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:39.075464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 130/265] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:38 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:39.083579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:39.159532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 136/266] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:04:39.165916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:39.179216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:39.197711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:39.277190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2575c2-e722-4ff7-b402-b0d89e1631f4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:39.323471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3bcbb-ef9c-4cc4-8fc9-1ebaa040f40b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:39.359801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:39.360007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747563-ad50-449e-b899-43424da88267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:39.360488 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:39.360792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747563-ad50-449e-b899-43424da88267 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:39.360981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:39.361097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747563-ad50-449e-b899-43424da88267 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:39.361255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:39.361346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747563-ad50-449e-b899-43424da88267 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:39.362160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=17957af4b7294da6bc63f6b61715c225) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:39.362476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:39.362575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e747563-ad50-449e-b899-43424da88267 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:39.363975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e747563-ad50-449e-b899-43424da88267 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:39.364077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7436ebb1-a8ff-4f8b-a488-00f6835a45f1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:39.371114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 137/267] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:39 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:39.376909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747563-ad50-449e-b899-43424da88267 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:39.377357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 131/268] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:39 2022] GET /identity/v3/role_assignments?user.id=17957af4b7294da6bc63f6b61715c225&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:39.488587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:39.517912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747563-ad50-449e-b899-43424da88267 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:39.559347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:39.560019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:39.560309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:39.560593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:39.561437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] RBAC: Adding query filter params (role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=17957af4b7294da6bc63f6b61715c225) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:39.561754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:39.563234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00521cc9-1da7-41b0-a346-2974aaf63efe None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:39.575246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 138/269] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:39 2022] GET /identity/v3/role_assignments?user.id=17957af4b7294da6bc63f6b61715c225&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:39.696971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186259-a66a-4e69-b292-1437bdb6053a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:39.697478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186259-a66a-4e69-b292-1437bdb6053a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:39.697552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186259-a66a-4e69-b292-1437bdb6053a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:39.699385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 132/270] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:39.721341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392334ec-faad-47be-932d-7f005c203904 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:39.721840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392334ec-faad-47be-932d-7f005c203904 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:39.721913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392334ec-faad-47be-932d-7f005c203904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:39.745494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-392334ec-faad-47be-932d-7f005c203904 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:39.746678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-392334ec-faad-47be-932d-7f005c203904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:39.821068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 139/271] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:39.849769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186259-a66a-4e69-b292-1437bdb6053a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:39.969052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186259-a66a-4e69-b292-1437bdb6053a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.003421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.011205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed0c62-6856-41df-beb0-80a22b7b5475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.012061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed0c62-6856-41df-beb0-80a22b7b5475 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.012343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed0c62-6856-41df-beb0-80a22b7b5475 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.012617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed0c62-6856-41df-beb0-80a22b7b5475 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.013830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed0c62-6856-41df-beb0-80a22b7b5475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:40.015359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed0c62-6856-41df-beb0-80a22b7b5475 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:40.017047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 133/272] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:40.023277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392334ec-faad-47be-932d-7f005c203904 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.034938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755677-6b2a-4bbc-988b-8dd1072c777e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.035247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755677-6b2a-4bbc-988b-8dd1072c777e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.035527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755677-6b2a-4bbc-988b-8dd1072c777e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.037471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 134/273] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:40.043212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.043505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.043787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.062953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:40.064490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:40.109875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.140819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392334ec-faad-47be-932d-7f005c203904 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.146571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 135/274] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:40.174133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.183296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd19096-dbab-48d2-a37a-d8194fab6282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.183984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19096-dbab-48d2-a37a-d8194fab6282 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.184270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19096-dbab-48d2-a37a-d8194fab6282 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.184550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19096-dbab-48d2-a37a-d8194fab6282 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.185274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd19096-dbab-48d2-a37a-d8194fab6282 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:40.186723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd19096-dbab-48d2-a37a-d8194fab6282 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:40.215179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 140/275] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:04:40 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:40.297853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b3f78-4e18-4bd2-ab37-b1cfba80cd72 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.330186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.342243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.343070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.343369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.343646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.347315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66281-f96a-4fa7-9c5a-e9efc334d5f7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.347615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66281-f96a-4fa7-9c5a-e9efc334d5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.347906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66281-f96a-4fa7-9c5a-e9efc334d5f7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.349363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 141/276] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:40.354898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.355211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.355503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.356870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:40.367008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:40.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:40.368867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:40.371121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 136/277] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:40.375315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.380690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:40.381940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:40.465895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 142/278] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:40.484825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e7bc7-f0e1-4950-87d6-52af8d38c6d2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.493066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.529849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.529849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.530136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.530360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.531128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:40.531441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:40.532838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b0772-9232-44eb-9de5-af6f3fe792cb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:40.543324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 137/279] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:40.544729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da077-6dc8-4f3e-b173-e5eadcb59365 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.545025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da077-6dc8-4f3e-b173-e5eadcb59365 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.545300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5da077-6dc8-4f3e-b173-e5eadcb59365 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.546793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 138/280] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:40.553021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.553420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.553697 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.561194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.574900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:40.576103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:40.622063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fa3ad-08de-46fb-994c-735c4de6d310 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.629394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.663605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 139/281] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:40.665119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.669042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.669848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.670133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.670411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.687900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:40.699010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:40.699976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:40.700804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:40.703752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 143/282] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:40.704818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.804286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282ef77-662e-4e23-9808-52e3ddd363df None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.838214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fce2c-46ef-4c99-a784-51bb24753e63 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:40.842560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.843204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.843588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.844044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] PATH_INFO: `/v3/users/30bf0c17420a4d49899367dfb9a3c34c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.858919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.859885 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=30bf0c17420a4d49899367dfb9a3c34c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:40.861585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:40.864060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 140/283] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/users/30bf0c17420a4d49899367dfb9a3c34c => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:40.865506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.885137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:40.886241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:40.886674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:40.887165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:40.900155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:40.903424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:40.908526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:40.909403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:40.910217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:40.913568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 144/284] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:40.914555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:40.981203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63f0f-c514-4793-b433-9cdfd952e4d0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.028744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.029776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.030080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.030367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.031420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:41.031751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.033301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.044775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 141/285] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:41.047267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:41.055863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f9314-8c32-47e1-bce6-3185efe307d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.093003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.094243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.094725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.095249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.096293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, user.id=30bf0c17420a4d49899367dfb9a3c34c, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:41.096810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.098800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.104951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 145/286] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jun 29 11:04:40 2022] GET /identity/v3/role_assignments?user.id=30bf0c17420a4d49899367dfb9a3c34c&scope.system=all&role.id=bcc6944090e84b989e96027d0859ed4b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:41.106116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:41.156726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:41.179376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:41.187191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b7ce4-ccc5-4fa9-9124-c944f98d223c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.239673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.240361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.240644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.240918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.241677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:41.241987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.243418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.265100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 142/287] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:41.272598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:41.293156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6f9d7-d746-4a13-85c4-02d172bb1b3e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.346475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.347433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.347666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.347946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] PATH_INFO: `/v3/users/8ac4878a26464e77b69de556c60c9815` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.349266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] RBAC: Authorizing `identity:get_user(user_id=8ac4878a26464e77b69de556c60c9815)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.350717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.352793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 146/288] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:41 2022] GET /identity/v3/users/8ac4878a26464e77b69de556c60c9815 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:41.359025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:41.421031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb081d-f38d-4949-8dd4-9643dbb8c769 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.462364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.463413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.463796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.467059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] PATH_INFO: `/v3/users/bf29025dc34f4af0bed2839e36f17e8d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.467059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] RBAC: Authorizing `identity:get_user(user_id=bf29025dc34f4af0bed2839e36f17e8d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.467426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.469849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 143/289] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:41 2022] GET /identity/v3/users/bf29025dc34f4af0bed2839e36f17e8d => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:41.475590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:41.510378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:41.599812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f5b0b-9313-4930-80e3-21fcf694285c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.629796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b24cad-9092-45d4-88f0-254181a18526 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.640383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.641255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.641537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.641802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.643526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:41.644384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.645971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.648461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:41 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:41.655841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:41.736535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.737126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.737411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.737691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.768252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:41.778063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a37df9-f164-4ced-a5ef-469c4436b8d2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:41.816584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:41.818277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:41.818564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:41.818844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/bf29025dc34f4af0bed2839e36f17e8d/roles/8ed59d1d11a84143b47bc7b37433b0bb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:41.820957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f8bcbe7c20482ea2f11baadd886fe4, user_id=bf29025dc34f4af0bed2839e36f17e8d, role_id=8ed59d1d11a84143b47bc7b37433b0bb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.822509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:41.837630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 145/291] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:04:41 2022] PUT /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/users/bf29025dc34f4af0bed2839e36f17e8d/roles/8ed59d1d11a84143b47bc7b37433b0bb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:41.915715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:41.917209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:42.069879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 147/292] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:42.075326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:42.186293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5ee58-0334-40c7-979c-187360cc2d2d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:42.223178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21faa17-d5b2-48ad-83a5-a2d95f48b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:42.224601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21faa17-d5b2-48ad-83a5-a2d95f48b83b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:42.224886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21faa17-d5b2-48ad-83a5-a2d95f48b83b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:42.225367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21faa17-d5b2-48ad-83a5-a2d95f48b83b None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:42.226568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21faa17-d5b2-48ad-83a5-a2d95f48b83b None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:42.228034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21faa17-d5b2-48ad-83a5-a2d95f48b83b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:42.229896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 146/293] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:42 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:42.235521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:42.244532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:42.338374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50d3f-3744-4ebe-bfc9-e82cc406ba68 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:42.375132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:42.375801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:42.376137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:42.376423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:42.377250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=8ac4878a26464e77b69de556c60c9815) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:42.377564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:42.379006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756610fe-c0c4-4414-a5dd-c86453bfb1aa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:42.385445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 148/294] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:42 2022] GET /identity/v3/role_assignments?user.id=8ac4878a26464e77b69de556c60c9815&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=bcc6944090e84b989e96027d0859ed4b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:42.699108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59c6f-dabb-4a6f-a745-fc6d45151470 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:42.699447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59c6f-dabb-4a6f-a745-fc6d45151470 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:42.699619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a59c6f-dabb-4a6f-a745-fc6d45151470 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:42.701500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 147/295] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:42.707665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:42.708790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:42.709703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:42.718008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21abf9-0d55-4958-88a2-a9c3bb2d379a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:42.718270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21abf9-0d55-4958-88a2-a9c3bb2d379a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:42.718554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21abf9-0d55-4958-88a2-a9c3bb2d379a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:42.719950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 148/296] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:42.725620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:42.725908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:42.726190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:42.730631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:42.733258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:42.744116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:42.745290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:42.764862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:42.820462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:42.825859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 149/297] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:42.826299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:42.850032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:42.851694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:42.963477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70b166-671f-4954-bc04-3427c6b7123d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:42.974279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc49158-0c44-49c9-adf4-a1f5a3a141c5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:43.010851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.011685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.011969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.012341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.012685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.013496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.013600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:43.013787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.014072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.015233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:43.016912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 150/299] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:43.022373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:43.026369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:43.034306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:43.035206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:43.036012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 150/300] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:43.043407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:43.057102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:43.116662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:43.155370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de1e1f-72f0-4b60-a2bd-f0d90ce85d4c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:43.173079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dda7a4-d6db-4fe9-874b-c3f01a0a810b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:43.195006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.195765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.196049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.196329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] PATH_INFO: `/v3/groups` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.197022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:43.198746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:43.211012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.211716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.212007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.212288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.213042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:43.213352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:43.214779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:43.219372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 151/301] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Jun 29 11:04:43 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:04:43.225078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 151/302] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:43.232509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:43.341123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:43.352018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94118c7b-b0ff-4653-80bc-bcc262be6e57 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:43.393544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e149e0-78c3-40e7-825d-dcdb521bb08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.394500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e149e0-78c3-40e7-825d-dcdb521bb08e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.394781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e149e0-78c3-40e7-825d-dcdb521bb08e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.395076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e149e0-78c3-40e7-825d-dcdb521bb08e None admin] PATH_INFO: `/v3/users/aba32303e83e4016b27977bbda945e2e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.409406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e149e0-78c3-40e7-825d-dcdb521bb08e None admin] RBAC: Authorizing `identity:get_user(user_id=aba32303e83e4016b27977bbda945e2e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:43.410887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e149e0-78c3-40e7-825d-dcdb521bb08e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:43.413747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 152/303] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:43 2022] GET /identity/v3/users/aba32303e83e4016b27977bbda945e2e => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:43.418597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:43.531418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9f36-dedc-4bb4-b017-5cd16f81d7f6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:43.553131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855bc14-cd98-423b-8697-3880e8058809 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.553433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855bc14-cd98-423b-8697-3880e8058809 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.553708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855bc14-cd98-423b-8697-3880e8058809 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.557338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 153/304] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:43.557683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:43.561775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.564446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.564446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.570540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.571241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.571532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.571816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.572657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] RBAC: Adding query filter params (role.id=8ed59d1d11a84143b47bc7b37433b0bb, user.id=aba32303e83e4016b27977bbda945e2e, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:43.572977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:43.574416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:43.580127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 152/305] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jun 29 11:04:43 2022] GET /identity/v3/role_assignments?user.id=aba32303e83e4016b27977bbda945e2e&scope.system=all&role.id=8ed59d1d11a84143b47bc7b37433b0bb => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:43.584229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:43.585710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:43.669705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 154/306] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:43.693687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:43.804779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec8803-2034-4823-be00-15e69d27a5ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:43.839786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:43.841063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:43.841567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:43.842040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:43.853485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:43.861631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:43.862475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:43.863301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:43.870759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 153/307] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:43.874352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:43.946700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:43.982767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e1629-dd70-4f65-aa9f-ca68e003bdab None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:44.021699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:44.022435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.022728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.023008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.023808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:44.024249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:44.025643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:44.034481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 155/308] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:44.040646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:44.092942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:44.151743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cabb4-b442-4073-b18b-06f22a53e33d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:44.187023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf9c6d-1792-43d2-a669-f383bf99ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:44.187919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9c6d-1792-43d2-a669-f383bf99ac3c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.188212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9c6d-1792-43d2-a669-f383bf99ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.188497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf9c6d-1792-43d2-a669-f383bf99ac3c None admin] PATH_INFO: `/v3/users/30bf0c17420a4d49899367dfb9a3c34c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.189702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf9c6d-1792-43d2-a669-f383bf99ac3c None admin] RBAC: Authorizing `identity:get_user(user_id=30bf0c17420a4d49899367dfb9a3c34c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:44.191182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf9c6d-1792-43d2-a669-f383bf99ac3c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:44.193180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 154/309] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:44 2022] GET /identity/v3/users/30bf0c17420a4d49899367dfb9a3c34c => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:44.198809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:44.260818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773fb8-bc95-4dda-a31a-fd5a21be5ca3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.261160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773fb8-bc95-4dda-a31a-fd5a21be5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.261428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773fb8-bc95-4dda-a31a-fd5a21be5ca3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.262775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 155/310] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:44.267679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.267976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.268265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.285562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:44.286808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:44.306598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cb298-dbcf-49ae-b382-276f8a8b1181 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:44.344186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:44.353550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:44.354920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.355683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.356563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] PATH_INFO: `/v3/system/users/30bf0c17420a4d49899367dfb9a3c34c/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.358775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30bf0c17420a4d49899367dfb9a3c34c, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:44.360505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:44.367502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 156/311] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:44.379155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 156/312] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Jun 29 11:04:44 2022] PUT /identity/v3/system/users/30bf0c17420a4d49899367dfb9a3c34c/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:44.384509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:44.443266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:44.505604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1869a-ced2-466f-94e3-db46520af745 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:44.545041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:44.546209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.546686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.547182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.558959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:44.567136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:44.568038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:44.568834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:44.571014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 157/313] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:44.577277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:44.682199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d1772-c0f1-4e80-9925-0247c428fb97 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:44.718553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:44.719542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.720010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.720468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.721418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:44.721906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:44.723497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:44.733538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 157/314] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:44.739351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:44.850056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418a489-a324-4bbc-8260-b3a9fb076f40 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:44.852850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:44.887095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:44.888274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:44.888743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:44.889228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] PATH_INFO: `/v3/users/bf29025dc34f4af0bed2839e36f17e8d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:44.890605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] RBAC: Authorizing `identity:get_user(user_id=bf29025dc34f4af0bed2839e36f17e8d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:44.892254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:44.894397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 158/315] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:44 2022] GET /identity/v3/users/bf29025dc34f4af0bed2839e36f17e8d => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:44.900617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:44.958964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:45.019372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fc546-60c6-4bce-b8c1-eb0fa2b0120c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:45.055344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:45.056007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.056299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.056582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.128476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:45.130467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:45.187447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:45.234007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:45.239684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:45.345020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bea35-534a-4186-b9cb-f9fd0f717e43 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:45.381610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea79a1-a13e-4179-be1c-93fa55f34c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:45.382847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea79a1-a13e-4179-be1c-93fa55f34c50 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.383363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea79a1-a13e-4179-be1c-93fa55f34c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.383866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea79a1-a13e-4179-be1c-93fa55f34c50 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.385254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea79a1-a13e-4179-be1c-93fa55f34c50 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:45.386910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea79a1-a13e-4179-be1c-93fa55f34c50 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:45.389155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 159/317] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:45 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:45.394719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:45.474175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc8e2-c5fb-467d-97e0-bf1280f49a63 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.474490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc8e2-c5fb-467d-97e0-bf1280f49a63 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.474753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc8e2-c5fb-467d-97e0-bf1280f49a63 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.477023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 160/318] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:45.482538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558acfa2-7a36-42cf-90f5-363b6567f9e8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.482847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558acfa2-7a36-42cf-90f5-363b6567f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.483165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558acfa2-7a36-42cf-90f5-363b6567f9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.499208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc6dc2-f3e6-44ef-8bd9-3eaadd3b06bc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:45.500754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-558acfa2-7a36-42cf-90f5-363b6567f9e8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:45.502035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-558acfa2-7a36-42cf-90f5-363b6567f9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:45.534459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:45.535140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.535429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.535706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.536571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] RBAC: Adding query filter params (role.id=8ed59d1d11a84143b47bc7b37433b0bb, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4, user.id=bf29025dc34f4af0bed2839e36f17e8d) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:45.536888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:45.538334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:45.551172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 159/319] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:04:45 2022] GET /identity/v3/role_assignments?user.id=bf29025dc34f4af0bed2839e36f17e8d&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=8ed59d1d11a84143b47bc7b37433b0bb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:45.567483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:45.583804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 161/320] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:45.609442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:45.637440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:45.724726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e12cda-3458-46ad-81a4-5a5d01ad4562 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:45.760880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:45.761958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.762420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.763067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.764440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:45.764596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67c198-a00c-4be5-b0b9-735712045286 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.764872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67c198-a00c-4be5-b0b9-735712045286 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.765160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67c198-a00c-4be5-b0b9-735712045286 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.766607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:45.766794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 162/321] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:45.768919 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 160/322] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:04:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:45.773513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.773513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.773513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.774443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:45.796947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:45.798142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:45.868953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:45.878820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 163/323] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:45.881390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4ce42-f9b1-4a1a-8c22-10dc363b5bfd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:45.900221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:45.919850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:45.920877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:45.921170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:45.921456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] PATH_INFO: `/v3/groups` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:45.922242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:45.923749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:45.947470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 161/324] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Jun 29 11:04:45 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:04:46.016318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:46.019599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2882a-ae85-4caf-bfbd-16b26f8a1bcc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:46.058282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:46.059124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.059410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.059687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.071583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:46.079442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:46.080355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:46.081166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:46.084128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 164/325] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:46.086775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:46.196806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d74e2-1608-4bd3-8395-92452be0d423 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:46.233901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:46.234583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.234869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.235180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.235941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:46.236253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:46.237632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:46.246727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 162/326] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:46.252514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:46.369703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2484c38-b0f2-4bb5-ae5a-15338f4e0213 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:46.408572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99f0aa-ceeb-4f35-b0cd-64baddea1860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:46.409462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f0aa-ceeb-4f35-b0cd-64baddea1860 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.409840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f0aa-ceeb-4f35-b0cd-64baddea1860 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.410121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99f0aa-ceeb-4f35-b0cd-64baddea1860 None admin] PATH_INFO: `/v3/users/aba32303e83e4016b27977bbda945e2e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.412303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f0aa-ceeb-4f35-b0cd-64baddea1860 None admin] RBAC: Authorizing `identity:get_user(user_id=aba32303e83e4016b27977bbda945e2e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:46.413755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99f0aa-ceeb-4f35-b0cd-64baddea1860 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:46.415852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 165/327] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:46 2022] GET /identity/v3/users/aba32303e83e4016b27977bbda945e2e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:46.421551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:46.437760 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:46.537649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f7949-15aa-4b7d-a8dd-49a4586e4609 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:46.542650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9647d5-7349-4d87-bcf1-ab08ed0c75a5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.543066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9647d5-7349-4d87-bcf1-ab08ed0c75a5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.543313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9647d5-7349-4d87-bcf1-ab08ed0c75a5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.544900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 166/328] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:46.551010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.551366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.551656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.574122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:46.575676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:46.586313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:46.587263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.587612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.587897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] PATH_INFO: `/v3/system/users/aba32303e83e4016b27977bbda945e2e/roles/8ed59d1d11a84143b47bc7b37433b0bb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.589589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aba32303e83e4016b27977bbda945e2e, role_id=8ed59d1d11a84143b47bc7b37433b0bb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:46.591151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:46.602068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 163/329] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Jun 29 11:04:46 2022] PUT /identity/v3/system/users/aba32303e83e4016b27977bbda945e2e/roles/8ed59d1d11a84143b47bc7b37433b0bb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:46.617935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:46.676156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 167/330] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:46.704664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:46.807915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:46.840681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffde4b0-0414-4177-9aa4-7374fc2bbac3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:46.881177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:46.881979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:46.882259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:46.882531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:46.899081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:46.906836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:46.907745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:46.908524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:46.911233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 164/331] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:46.913789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:47.047427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a350-af3c-489d-83a8-a6b6fee78cb6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:47.094474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:47.095194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:47.095483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:47.095762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:47.096509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:47.096812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:47.098175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:47.110184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 168/332] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:47.116277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:47.248261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db8494-2e81-4022-8c42-b34e70b77b3d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:47.285172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638df575-8cee-4ff2-b62b-a57af4d4ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:47.286901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638df575-8cee-4ff2-b62b-a57af4d4ea45 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:47.287411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638df575-8cee-4ff2-b62b-a57af4d4ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:47.287902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638df575-8cee-4ff2-b62b-a57af4d4ea45 None admin] PATH_INFO: `/v3/users/30bf0c17420a4d49899367dfb9a3c34c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:47.289302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638df575-8cee-4ff2-b62b-a57af4d4ea45 None admin] RBAC: Authorizing `identity:get_user(user_id=30bf0c17420a4d49899367dfb9a3c34c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:47.290956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638df575-8cee-4ff2-b62b-a57af4d4ea45 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:47.293117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:47 2022] GET /identity/v3/users/30bf0c17420a4d49899367dfb9a3c34c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:47.298417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:47.322818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:47.406933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e1fa8-7347-42a0-8054-dc7a5718050f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:47.448425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:47.449438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:47.449919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:47.450415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:47.451593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] RBAC: Adding query filter params (role.id=bcc6944090e84b989e96027d0859ed4b, user.id=30bf0c17420a4d49899367dfb9a3c34c, scope.system=all) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:47.452147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:47.453777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5eda-10ea-4cb7-ba6d-039d221da536 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:47.467989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 169/334] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jun 29 11:04:47 2022] GET /identity/v3/role_assignments?user.id=30bf0c17420a4d49899367dfb9a3c34c&scope.system=all&role.id=bcc6944090e84b989e96027d0859ed4b => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:48.844659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1046084-c4dd-4614-83c0-61a3f83c2f3c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:48.845164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1046084-c4dd-4614-83c0-61a3f83c2f3c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:48.845240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1046084-c4dd-4614-83c0-61a3f83c2f3c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:48.846700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:48.853510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a0e9-8ca6-46dc-b77c-e4eb8d355b12 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:48.853510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a0e9-8ca6-46dc-b77c-e4eb8d355b12 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:48.853510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2a0e9-8ca6-46dc-b77c-e4eb8d355b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:48.872749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-05b2a0e9-8ca6-46dc-b77c-e4eb8d355b12 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:48.874312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-05b2a0e9-8ca6-46dc-b77c-e4eb8d355b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:48.966298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:48.999111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1046084-c4dd-4614-83c0-61a3f83c2f3c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.002320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.116361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c8a1-2e86-4db5-8834-df2c5788a009 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.117129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c8a1-2e86-4db5-8834-df2c5788a009 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.117717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048c8a1-2e86-4db5-8834-df2c5788a009 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.125718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 171/337] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:49.133910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524015f-d5b5-4750-8687-a47ccbedca1e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.134202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524015f-d5b5-4750-8687-a47ccbedca1e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.134485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524015f-d5b5-4750-8687-a47ccbedca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.143903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1046084-c4dd-4614-83c0-61a3f83c2f3c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:49.164052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9524015f-d5b5-4750-8687-a47ccbedca1e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:49.165472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9524015f-d5b5-4750-8687-a47ccbedca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:49.175064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.183699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:49.184618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.184797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.185066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.196288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:49.205005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:49.205948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:49.206774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:49.210047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 167/338] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:49.216048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.287896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.312696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 172/339] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:49.314046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7d77-734d-4df2-b987-1373b83958e3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.314338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7d77-734d-4df2-b987-1373b83958e3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.314619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f7d77-734d-4df2-b987-1373b83958e3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.316062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 173/340] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:49.321145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.321410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.321695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.333696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a03b6-4982-489f-b1c0-a826aea6bd2d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:49.360113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:49.361309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:49.371184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:49.372171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.372662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.373139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.374101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:49.374628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:49.376290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:49.385688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 168/341] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:49.386774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.497350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 174/342] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:49.499341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.504164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ddaffc-9f2c-4626-a6bb-8ddd00e36708 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:49.529853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.542441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:49.543708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.544199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.544680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.557834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:49.566193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:49.569480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:49.570313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:49.573453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 169/343] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:49.574536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.614824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.667467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94db75-81fe-4178-8aba-8086a23c3bf1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:49.688942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad00be-6160-440c-8aa3-5b75ebf7bc74 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:49.716767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:49.717361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.717653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.717935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.728468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:49.729593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.730083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.730582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.742475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:49.750769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:49.751727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:49.752555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:49.756948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 170/344] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:49.757165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.808301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.815388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:49.817940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:49.869422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2c9f-5b96-45f6-8edb-87f0b1d3a32a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:49.889561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:49.912126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:49.913374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.914043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.914541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.915798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:49.916315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:49.918384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d35e2f-421a-42bd-91f9-91271ffd03d5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:49.930545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 171/345] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:49.931440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 175/346] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:49.932323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959bc75-2591-4b8f-a433-16e1b9953b83 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:49.932820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959bc75-2591-4b8f-a433-16e1b9953b83 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:49.933316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959bc75-2591-4b8f-a433-16e1b9953b83 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:49.939097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 172/347] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:49.939520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:49.940508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959bc75-2591-4b8f-a433-16e1b9953b83 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.066511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea8eca-cac3-48fe-a2d6-c7bccfc4b0a8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.081679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959bc75-2591-4b8f-a433-16e1b9953b83 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.090190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.116031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.117354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.117641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.117919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.118699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:50.119007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.120431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.132428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.133398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.133755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 176/348] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:50.134157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.134563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.134889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.179309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.231001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.232896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.269481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b205565-1ea7-4769-9f7b-d013c415c310 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.312245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfff132-70e0-4240-9195-687dead418f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.313049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff132-70e0-4240-9195-687dead418f0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.313329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff132-70e0-4240-9195-687dead418f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.313605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfff132-70e0-4240-9195-687dead418f0 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.314973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfff132-70e0-4240-9195-687dead418f0 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.316461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfff132-70e0-4240-9195-687dead418f0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.323145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 177/349] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:50.323145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.323145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.323145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.339458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:50.340790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:50.385548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 173/350] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:50.386745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.396319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.423482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 178/351] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:50.424534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.465090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.518717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12655-11cb-4169-8b72-d820ab7af021 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.546940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e622be-022f-4ef9-82e7-22d69721eea0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.557993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.558999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.559493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.559952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.585180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.586303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.586487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.586812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.593895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.595317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.597428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 179/352] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:50.597985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.643487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.645536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.655136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.700618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.713177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fc54e-5472-405b-8b65-45459feb62dd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.749274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.750389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.750678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.750955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.752268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.753722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.756018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 180/353] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:50.756888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.766515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 174/354] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:50.767408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.871773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915dc9a-6a12-44c6-b3d3-f2e37234e460 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.883907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1eb24-2105-4db9-89a6-1dc79cdbcda6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:50.893056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:50.912326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899fb02-9f7c-4f2c-861e-55a3b83a8f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.913133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899fb02-9f7c-4f2c-861e-55a3b83a8f67 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.913416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899fb02-9f7c-4f2c-861e-55a3b83a8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.913698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899fb02-9f7c-4f2c-861e-55a3b83a8f67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.924994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899fb02-9f7c-4f2c-861e-55a3b83a8f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:50.928910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:50.929572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.929859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.930141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.930979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=af097cba5b204232b159af38f2488126) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:50.931326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:50.932778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b894f-868d-41fd-a882-dc835c9dc775 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5899fb02-9f7c-4f2c-861e-55a3b83a8f67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:50.933988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:50.934905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:50.935815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 181/355] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:50.936468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5689-7899-4521-99d7-228c4713d2fd None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.936761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5689-7899-4521-99d7-228c4713d2fd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.938592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5689-7899-4521-99d7-228c4713d2fd None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.938592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 182/356] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:50.938894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 175/357] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=af097cba5b204232b159af38f2488126&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:50.940186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8a18-c911-4a07-b2a9-1952581014a5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:50.940535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8a18-c911-4a07-b2a9-1952581014a5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:50.940821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8a18-c911-4a07-b2a9-1952581014a5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:50.942177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 176/358] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:50.943730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe8a18-c911-4a07-b2a9-1952581014a5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.947229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5689-7899-4521-99d7-228c4713d2fd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:50.979905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.087625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe8a18-c911-4a07-b2a9-1952581014a5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.096657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5689-7899-4521-99d7-228c4713d2fd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.131607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2db807-209d-4f08-b19d-6a6a3b240c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.132801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2db807-209d-4f08-b19d-6a6a3b240c9d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.133245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2db807-209d-4f08-b19d-6a6a3b240c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.133541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2db807-209d-4f08-b19d-6a6a3b240c9d None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.134708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2db807-209d-4f08-b19d-6a6a3b240c9d None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:51.136228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2db807-209d-4f08-b19d-6a6a3b240c9d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:51.137922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 177/359] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:51.139340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.140212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.140310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932f56e-fef1-448b-a74a-85c153e2fa53 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.140493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.140603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932f56e-fef1-448b-a74a-85c153e2fa53 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.140772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.140866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932f56e-fef1-448b-a74a-85c153e2fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.143684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:51.145140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:51.147009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 183/360] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:50 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:51.148809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.161681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4932f56e-fef1-448b-a74a-85c153e2fa53 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:51.162950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4932f56e-fef1-448b-a74a-85c153e2fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:51.199424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.256650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 178/361] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:51.258264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.258716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.259239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.279832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.287166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:51.288941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:51.296581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835b73-c313-4975-8cbd-8187c5fad34b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.337396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.338414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.338907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.339465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.340369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:51.340827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:51.342360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:51.354049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 184/362] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:51.355134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.381711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 179/363] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:51.382654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.498622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.504563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f8472-4239-4396-aa89-4dc8f591bb09 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.513246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5f06-9252-4efd-b47d-da4905d52479 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.554787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.555476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.555762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.556042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.556878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:51.557276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:51.558614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:51.562898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.563995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.564353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.564639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.566759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:51.568802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:51.570575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 185/365] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:51.570704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 180/365] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=bcc6944090e84b989e96027d0859ed4b => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:51.571254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.571508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.602345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.707345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcf765-bbe8-458a-94ca-3c79f434d13e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.727897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be875477-493d-4141-b267-4f2d6843ebb5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.750287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.751275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.751562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.751840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] PATH_INFO: `/v3/users/aba32303e83e4016b27977bbda945e2e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.753209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] RBAC: Authorizing `identity:get_user(user_id=aba32303e83e4016b27977bbda945e2e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:51.754766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:51.756956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 181/366] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/users/aba32303e83e4016b27977bbda945e2e => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:51.758011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.784060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.784813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.785099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.785377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.803830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.806906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:51.819021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:51.819967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:51.820761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:51.823493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 186/367] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:51.824413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:51.900978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323e251-955b-4d5f-b342-ed30a8ecbdb4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.934382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:51.944643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:51.945657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:51.946084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:51.946499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:51.960086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:51.961455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2a6e-db3b-4696-8c8f-6ff5b95cf1d1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:51.969841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:51.970952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:51.971961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:51.974969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 182/368] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:51.976050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.014581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.015272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.015565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.015846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.016820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=af097cba5b204232b159af38f2488126) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:52.016995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.018411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.024410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 187/369] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=af097cba5b204232b159af38f2488126&role.id=bcc6944090e84b989e96027d0859ed4b => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:52.025216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.098294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:52.111374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b67dc-315b-4318-a505-9ba2650375dd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:52.151551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.152565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.153075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.153580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.154644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] RBAC: Adding query filter params (role.id=8ed59d1d11a84143b47bc7b37433b0bb, user.id=aba32303e83e4016b27977bbda945e2e, scope.system=all) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:52.155207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.156947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.170242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 183/370] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jun 29 11:04:51 2022] GET /identity/v3/role_assignments?user.id=aba32303e83e4016b27977bbda945e2e&scope.system=all&role.id=8ed59d1d11a84143b47bc7b37433b0bb => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:52.175559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.204678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ab813-543f-40a4-8317-c921e329575d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:52.253209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.253903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.254242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.254578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.256231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:52.256575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.258093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.277341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 188/371] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:52.283298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.289300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:52.315552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21da96c-7a9f-48d5-b0b0-6d383157e06b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:52.395894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.396508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.396797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.397132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.397903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:52.398517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.400393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.417505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 184/372] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:52.423854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.452281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:52.521052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a08190-fc20-42b8-b1a3-7224a001aa6b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:52.569098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.569759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.570043 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.570321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.590022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aa570-8197-402c-a4ae-4e3b2aed1a4a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:52.630933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.631629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.632025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.632315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.661715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.663126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.665918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:52.721164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.722660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.734996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:52.769091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 189/373] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:04:52.777306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.880941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 185/374] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:52.890075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4d39e-0044-4cf2-b556-bf3cdc124767 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:52.893197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:52.894897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:52.944512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:52.945314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:52.945597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:52.945873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:52.947855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:52.949294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:52.952254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 190/375] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:52.958868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:53.102616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7ba4e-897c-4087-84c8-144a5ce51df4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:53.120984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:53.152118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffdf1c-63ef-4f00-aa59-a13895ef099c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:53.159613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:53.160501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.160784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.161693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] PATH_INFO: `/v3/projects/06d95d128265441e8d2bda222376dded` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.163029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] RBAC: Authorizing `identity:get_project(project_id=06d95d128265441e8d2bda222376dded)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:53.167070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:53.170200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 186/376] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/projects/06d95d128265441e8d2bda222376dded => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:53.174186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:53.214140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:53.216487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.217208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.218884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.220558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:53.225794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:53.228569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 191/377] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:52 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:53.235423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:53.313011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:53.357324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c9584-19b6-4cd0-aa02-21665f6380ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:53.401074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba02e0-d2f0-4f63-8229-dc4f23e1e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:53.402346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba02e0-d2f0-4f63-8229-dc4f23e1e29e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.402840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba02e0-d2f0-4f63-8229-dc4f23e1e29e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.403490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba02e0-d2f0-4f63-8229-dc4f23e1e29e None admin] PATH_INFO: `/v3/groups/0ef09ba3c2ad4d89b57692db48b5cf6b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.412508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba02e0-d2f0-4f63-8229-dc4f23e1e29e None admin] RBAC: Authorizing `identity:get_group(group_id=0ef09ba3c2ad4d89b57692db48b5cf6b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:53.414494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba02e0-d2f0-4f63-8229-dc4f23e1e29e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:53.416693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 187/378] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:53 2022] GET /identity/v3/groups/0ef09ba3c2ad4d89b57692db48b5cf6b => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:53.418203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eb80f-da3f-43c0-ae97-684fe724eea0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.418696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eb80f-da3f-43c0-ae97-684fe724eea0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.419208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eb80f-da3f-43c0-ae97-684fe724eea0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.420899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 188/379] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:53.422203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eb80f-da3f-43c0-ae97-684fe724eea0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:53.423511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5261f-5237-4899-b104-5218a1055702 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:53.468645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:53.469699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.470243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.470755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.473286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:53.473944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:53.475227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:53.477022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098c77e-dfff-4669-bf23-26078daf2a24 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:53.486449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 192/380] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:53 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:53.488109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.488499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.488902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.508818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:53.510315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:53.587594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eb80f-da3f-43c0-ae97-684fe724eea0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:53.658720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:53.659678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.660600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.661082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.662117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] RBAC: Adding query filter params (group.id=0ef09ba3c2ad4d89b57692db48b5cf6b, role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=06d95d128265441e8d2bda222376dded) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:53.662587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:53.664636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:53.669229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 193/381] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:53.679184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 189/382] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:53 2022] GET /identity/v3/role_assignments?group.id=0ef09ba3c2ad4d89b57692db48b5cf6b&scope.project.id=06d95d128265441e8d2bda222376dded&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:53.710552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:53.770509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:53.859707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc22f01-9cb8-4779-866b-87ccd47b5c52 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:53.906002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:53.906838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:53.907175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:53.907461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:53.922618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:53.931371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:53.933430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:53.934486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 194/383] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:53.938899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:54.095899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4a41d-e1c3-4acc-9d06-6a29c369e968 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:54.104290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:54.142105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:54.142882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.143200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.143478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.144224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:54.147312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:54.148728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d7c51-e7ae-4643-aa2f-54b628b7f310 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:54.157424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 190/384] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:54.163182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:54.280563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c146b-8a3c-4e8f-a63a-88eda1386a20 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.280881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c146b-8a3c-4e8f-a63a-88eda1386a20 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.281122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c146b-8a3c-4e8f-a63a-88eda1386a20 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.282620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 191/385] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:54.288115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.288680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.289189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.295928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:54.303557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca27b25-a284-41a8-b781-c14c9cc25119 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:54.308897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:54.310380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:54.369255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:54.370055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.370336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.370614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.373082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:54.375111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:54.379104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 195/386] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:54 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:54.386582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:54.450937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 192/387] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 29 11:04:54.484942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:54.523447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8243a2-9607-4292-8ca6-e845b05d2505 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:54.569987 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:54.570877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.571208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.571489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.572689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:54.574822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:54.577639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 196/388] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:54 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:54.588019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:54.627542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:54.710575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb69c33-ae18-46dd-bcc1-f593f84e7342 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:54.750070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:54.751311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.751901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.752332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.754891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=af097cba5b204232b159af38f2488126, group_id=9501d4c4c6e249cab7dda9761b43c6a3, role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:54.756669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:54.765497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:54.770233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a0cf7-0784-4e55-93b6-9119e7fd92cd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:54.778617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 197/389] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jun 29 11:04:54 2022] PUT /identity/v3/projects/af097cba5b204232b159af38f2488126/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:54.845618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ea028-0519-478b-8c75-96fbaf362790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:54.846447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea028-0519-478b-8c75-96fbaf362790 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:54.846733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea028-0519-478b-8c75-96fbaf362790 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:54.847010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ea028-0519-478b-8c75-96fbaf362790 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:54.868268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ea028-0519-478b-8c75-96fbaf362790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e31ea028-0519-478b-8c75-96fbaf362790 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:54.876641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:54.877633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:54.878457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 193/390] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:54.885874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.037285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:55.053219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7a6f6-5e66-4447-b9ce-bd18d54e2ad8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:55.067004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016383bd-2f95-4d3e-99b1-a8d7a1972120 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.067361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016383bd-2f95-4d3e-99b1-a8d7a1972120 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.067647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016383bd-2f95-4d3e-99b1-a8d7a1972120 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.069073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 194/391] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:55.076761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.077495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.079291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.101896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:55.103015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:55.105340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.105340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.105340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.105340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:55.105340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:55.106215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:55.106657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:55.121170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 198/392] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:55.128999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.229371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 195/393] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:55.264677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d472b-e88f-4256-83d2-c1416356b950 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:55.273554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.317417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:55.318944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.319497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.320010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.322965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:55.324445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:55.326234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 199/394] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:55 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:55.334722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.368103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:55.444299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:55.468726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3832874-8b33-4ab5-bc38-9630fd909d6a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:55.505738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77a2d5-76b7-40bb-b1e3-c3659982c1de None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:55.513031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:55.513855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.514147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.514427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.526477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:55.538761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:55.539753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:55.540576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:55.542388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 196/395] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:55.548168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.592389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:55.593272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.593556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.593835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.595026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:55.596500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:55.598347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 200/396] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:55 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:55.604824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.672628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c015f-648e-49e0-b0cc-724a18cf55d5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:55.740201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:55.740795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.741080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.741359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.742122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:55.745003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:55.747907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:55.768831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 197/397] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:55.771711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:55.790406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:55.795558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:55.812185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34858f-9b54-4180-8cb0-d6dcfe88ce4a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:55.882579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:55.883501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:55.883793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:55.884079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:55.886696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f8bcbe7c20482ea2f11baadd886fe4, group_id=9501d4c4c6e249cab7dda9761b43c6a3, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:55.888909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:55.911777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 201/398] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jun 29 11:04:55 2022] PUT /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:04:55.959253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1b48b-b6d8-4a0f-a98c-0ff551b57c24 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:56.005442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a25b-283e-4d63-9a6f-2992ac2ce7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:56.006584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a25b-283e-4d63-9a6f-2992ac2ce7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.007105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a25b-283e-4d63-9a6f-2992ac2ce7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.007543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a25b-283e-4d63-9a6f-2992ac2ce7b5 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.008998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6a25b-283e-4d63-9a6f-2992ac2ce7b5 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:56.010754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6a25b-283e-4d63-9a6f-2992ac2ce7b5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:56.013062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 198/399] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:55 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:56.020289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.178054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb9f36-2647-4cb2-9247-6e0a4658cac2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:56.178814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742857a-0d44-4ebe-b8d7-827b68e61281 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.179705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742857a-0d44-4ebe-b8d7-827b68e61281 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.180087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742857a-0d44-4ebe-b8d7-827b68e61281 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.181713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 199/400] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:56.186512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.186912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.187362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.205472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:56.206782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:56.237059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:56.239018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.240191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.241405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.249027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:56.249027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:56.249363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 202/401] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:56 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:56.259308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.295177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:56.329424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 200/402] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:56.363930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.376745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:56.439781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74e38c-b8aa-4174-af1e-9cb61e3eb6fa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:56.474546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b13e8-77cd-4c7a-a19c-d36c52fb1f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:56.475459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b13e8-77cd-4c7a-a19c-d36c52fb1f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.475744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b13e8-77cd-4c7a-a19c-d36c52fb1f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.476018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b13e8-77cd-4c7a-a19c-d36c52fb1f85 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.477975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b13e8-77cd-4c7a-a19c-d36c52fb1f85 None admin] RBAC: Authorizing `identity:create_grant(project_id=af097cba5b204232b159af38f2488126, group_id=9501d4c4c6e249cab7dda9761b43c6a3, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:56.479427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b13e8-77cd-4c7a-a19c-d36c52fb1f85 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:56.496343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 203/403] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jun 29 11:04:56 2022] PUT /identity/v3/projects/af097cba5b204232b159af38f2488126/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:04:56.501541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1304-6779-49b1-b978-84d21ef95b30 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.501541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1304-6779-49b1-b978-84d21ef95b30 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.501541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1304-6779-49b1-b978-84d21ef95b30 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.503800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 204/404] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:56.505623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.505917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.506201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.530384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:56.534049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:56.565181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b355b-0cd6-462d-ac11-bc840960ecee None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:56.642314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:56.645084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.647494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.647904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.667791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 205/405] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:56.670064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:56.678826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:56.679755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:56.680583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:56.683392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 201/406] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:56.688885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.700163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:56.702677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.792787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:56.810124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af0725-4af2-458b-a9a9-8751ed5bd4d1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:56.850231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d4ef-ec15-4a39-9971-82de8cd6a2bc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:56.862541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:56.863248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.863538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.863813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.864684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:56.864992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:56.866369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:56.883101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 206/407] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:56.896769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.910500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:56.911906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:56.912237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:56.912522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:56.938251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:56.946168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:56.947082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:04:56.947877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:56.955798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 202/408] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:56.964355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:56.979369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:57.015755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f91ba-77db-4a97-bf45-e3397645677a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.110969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48934e68-5806-45f2-ad11-512805f62200 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.112296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.113173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.113459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.113745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.119730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.121195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.123141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 207/409] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:56 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:57.129227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:57.139447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:57.149776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.150863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.151538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.152014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.153434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:57.153939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.155551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.165742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 203/410] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:57.172008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:57.290705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1c02f-5023-484c-af9d-79e7f41ea1d1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.331414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.332335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.332626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.333477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] PATH_INFO: `/v3/groups/0ef09ba3c2ad4d89b57692db48b5cf6b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.334748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] RBAC: Authorizing `identity:get_group(group_id=0ef09ba3c2ad4d89b57692db48b5cf6b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.337655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.340658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 204/411] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:57 2022] GET /identity/v3/groups/0ef09ba3c2ad4d89b57692db48b5cf6b => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:57.347370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:57.356469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4798-9dc1-4149-9f81-61eff3567791 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.418113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.418909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.419224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.419508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.421338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.422770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.424793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 208/412] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:57 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:57.431682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:57.442079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:57.453753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:57.502292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bfa85-9d71-4458-9081-f969c53377e6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.541023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c1f39-8407-4a7e-8dd0-119e509daeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.542254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1f39-8407-4a7e-8dd0-119e509daeec None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.542641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1f39-8407-4a7e-8dd0-119e509daeec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.543020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c1f39-8407-4a7e-8dd0-119e509daeec None admin] PATH_INFO: `/v3/projects/06d95d128265441e8d2bda222376dded` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.544329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1f39-8407-4a7e-8dd0-119e509daeec None admin] RBAC: Authorizing `identity:get_project(project_id=06d95d128265441e8d2bda222376dded)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.545063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251098ad-f336-4f71-aa02-f68fd935ebd6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.545971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c1f39-8407-4a7e-8dd0-119e509daeec None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.548366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 205/413] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:57 2022] GET /identity/v3/projects/06d95d128265441e8d2bda222376dded => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:57.549792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6d1c-91a8-4af0-895a-103ebadc5885 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.550181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6d1c-91a8-4af0-895a-103ebadc5885 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.550560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff6d1c-91a8-4af0-895a-103ebadc5885 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.553221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 206/414] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:57.562282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.562839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.563291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.583703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:57.584629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.585457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:57.585613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.585993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.586343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.588778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] RBAC: Authorizing `identity:create_grant(project_id=c8f8bcbe7c20482ea2f11baadd886fe4, group_id=9501d4c4c6e249cab7dda9761b43c6a3, role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.590385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.608104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 209/415] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jun 29 11:04:57 2022] PUT /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4/groups/9501d4c4c6e249cab7dda9761b43c6a3/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:57.609242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:57.702048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 207/416] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:57.727156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:57.755577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:57.800392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0acbd-007a-446b-bad2-27603d5ffdbd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.821582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:57.837951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.839167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.839641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.840123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] PATH_INFO: `/v3/projects/06d95d128265441e8d2bda222376dded/groups/0ef09ba3c2ad4d89b57692db48b5cf6b/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.842272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d95d128265441e8d2bda222376dded, group_id=0ef09ba3c2ad4d89b57692db48b5cf6b, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:57.843936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:57.862341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 210/417] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jun 29 11:04:57 2022] PUT /identity/v3/projects/06d95d128265441e8d2bda222376dded/groups/0ef09ba3c2ad4d89b57692db48b5cf6b/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:04:57.871362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e45b0d-6cb1-458e-8bb0-31028a6dca15 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:57.912456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:57.913442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:57.913840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:57.914120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:57.928032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:57.936802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:57.937765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:04:57.938596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:57.942918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 208/418] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:04:57.945343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:58.059443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841d5f-3f19-4476-b1c2-31bef15335b0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:58.085329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:58.098062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:58.098255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.098939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.099291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.100156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:58.100466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:58.102132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b5fba-be78-4ee0-8273-3f6edff596a3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:58.115107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 211/419] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:58.117335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:58.221861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63540ce3-969a-46ca-bbb3-72f679797c7e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:58.238455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:58.257836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:58.258460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.258753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.259049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.310120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21cad2-c87a-4ea3-8b85-7aa2ec9b4efb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.310434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21cad2-c87a-4ea3-8b85-7aa2ec9b4efb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.310674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21cad2-c87a-4ea3-8b85-7aa2ec9b4efb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.316177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 212/420] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:04:58.318528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.318815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.319121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.339229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:58.340479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:58.346445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:58.347963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:58.418206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 213/421] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:04:58.445262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:58.573299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 209/422] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:58.578465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:58.599093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b09f92-c4ce-4ffa-be89-69ce0266a401 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:58.603729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:58.626589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:58.665649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:58.666462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.666746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.667027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.684427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:58.698877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:58.700150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:58.700952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:04:58.706405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 214/423] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:58.719647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:58.749701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60215a1-20b9-4c01-9ef5-7fa8fe5b9742 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:58.812092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:58.812964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.813249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.813528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.815372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:58.816815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:58.818531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 210/424] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:58 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:58.825406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:58.886316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141bc05-5af3-42de-b7b8-5e2cf8544249 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:58.941960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:58.943337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.944227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:58.944548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.945949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.946930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] RBAC: Adding query filter params (name=member) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:58.947644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:58.950415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcf357-56ba-4ac5-ba67-a666ff9d387b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:58.962310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 215/425] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:58.962456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac22898-1a27-4904-a750-72cba84675ee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:58.963944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8dad-2b00-423c-b5ec-144821dfc558 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:58.964441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8dad-2b00-423c-b5ec-144821dfc558 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:58.964936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b8dad-2b00-423c-b5ec-144821dfc558 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:58.966706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 216/426] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:04:58.967699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b8dad-2b00-423c-b5ec-144821dfc558 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.008434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14f4a9-9a7a-4c92-a25c-aa362f2780fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.009389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f4a9-9a7a-4c92-a25c-aa362f2780fc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.009606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f4a9-9a7a-4c92-a25c-aa362f2780fc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.009856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14f4a9-9a7a-4c92-a25c-aa362f2780fc None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.011584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f4a9-9a7a-4c92-a25c-aa362f2780fc None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.012644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14f4a9-9a7a-4c92-a25c-aa362f2780fc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.014602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 211/427] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:58 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:59.015868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.016155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.016487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.017325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.034860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:04:59.035835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:04:59.086743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b8dad-2b00-423c-b5ec-144821dfc558 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.109261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 212/428] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:04:59.110349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.125052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.126083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.126592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.127083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.197420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.200018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.201669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.217655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b2753-e85b-4888-bdb8-b1ae7942f97d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.243514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.253940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.254597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.255466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.255738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.256555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=af097cba5b204232b159af38f2488126) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:59.256870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.258318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.264866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 213/429] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=af097cba5b204232b159af38f2488126&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:59.265751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.315461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 217/430] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:04:59.323362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.380567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150ab99-5a81-4076-bf17-4cd2796fca90 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.420444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.420994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.421283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.421563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.433531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:04:59.441693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:04:59.443259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:04:59.444074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 214/431] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:04:59.452416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.471351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.473552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7668c220-71ff-42e3-8486-9efb48ffcee5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.513328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.514776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.515285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.515766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.517184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.519067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.521936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 218/432] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:59.532272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.542497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.600966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2ca84-08bd-4f0a-b780-9334fe7caf00 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.646954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.649329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.649607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.649978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.650700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:59.651012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.652423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.661793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 215/433] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:59.666611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.668129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a219a-edee-4fd4-b65a-e79bb4bbb3d4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.708621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.709978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.710474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.710947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.712469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.714251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.716525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 219/434] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:04:59.721949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:04:59.744809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.783124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f5a0-f76c-41ea-be28-17975a80d12f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.814831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:04:59.819255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23141841-2ca9-4782-81de-2db82d9ba728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.819920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141841-2ca9-4782-81de-2db82d9ba728 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.820205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141841-2ca9-4782-81de-2db82d9ba728 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.820481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141841-2ca9-4782-81de-2db82d9ba728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.847429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecf31d7-d49d-46e6-bcfd-e04a006e5e93 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:04:59.889765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:04:59.890898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:04:59.891425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:04:59.891911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:04:59.892959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:04:59.893075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23141841-2ca9-4782-81de-2db82d9ba728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.893585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:04:59.894453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23141841-2ca9-4782-81de-2db82d9ba728 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.895548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:04:59.907289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 220/435] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=bcc6944090e84b989e96027d0859ed4b => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:04:59.967592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.013216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 216/436] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:00.018511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.133440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5b799-f85c-4e88-bef9-0d502cd06aef None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.145370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72720d04-1f27-450c-9bfb-fded59fae257 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.145690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72720d04-1f27-450c-9bfb-fded59fae257 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.145938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72720d04-1f27-450c-9bfb-fded59fae257 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.147464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 217/437] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:00.152409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.152708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.152990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.172224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.173028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.173128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:00.173315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.173595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] PATH_INFO: `/v3/projects/af097cba5b204232b159af38f2488126` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.174289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:00.174774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] RBAC: Authorizing `identity:get_project(project_id=af097cba5b204232b159af38f2488126)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:00.176282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:00.179121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 221/438] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/projects/af097cba5b204232b159af38f2488126 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:00.184416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.193784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.251480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 218/439] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:05:00.274240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.291331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9e8a5-c0c2-4a5c-b1ce-88d523fb8640 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.327546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.328805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.329304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.329739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.330922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:00.332388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:00.334192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 222/440] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:00.339602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.381050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.384901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf2c5b-ff26-4149-ae4d-f5bdf8e3de2d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.420898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.421698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.421980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.422354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.425362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.434354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:00.442496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:00.443401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:00.444209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 219/441] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:00.449534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.454423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9f2d5-7004-4888-8ed4-07d84cf9c79e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.489389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.490027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.490314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.490593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.491864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=bcc6944090e84b989e96027d0859ed4b, scope.project.id=af097cba5b204232b159af38f2488126) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:00.492181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:00.494249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc749e-f8f0-471c-8ee1-b0673d54aa99 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:00.500141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 223/442] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=af097cba5b204232b159af38f2488126&role.id=bcc6944090e84b989e96027d0859ed4b => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:00.501345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b96c-901b-4f8c-8d16-05fc1881a0c0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.501638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b96c-901b-4f8c-8d16-05fc1881a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.501922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1b96c-901b-4f8c-8d16-05fc1881a0c0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.507100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 224/443] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:00.508894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.509228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.509518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.527971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:00.529217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:00.566084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad20de-c975-47dc-80e3-ca07738aa0de None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.615065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 225/444] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:00.616292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.617120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.617479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.617830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.618677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:00.619086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:00.620579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:00.634492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 220/445] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:00.634689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.636159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.661504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.718038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.753644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c3005-4807-4f5f-b2c0-fd3c6b3d1c6c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.757682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9d890-c9a1-42a5-81bd-48ca940e3cb6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.796316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.797224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.797702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.797984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.799839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:00.801271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:00.801603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:00.801887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:00.815648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:00.824327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:00.825236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:00.826041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 226/446] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:00.832329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:00.886720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:00.888231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:00.912190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:00.954902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67163ee3-f1ba-40af-b644-9df5afd3fc42 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:00.993504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:01.002341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.003029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.003404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.003656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.004416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:01.005277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.008419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.008565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 221/447] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:05:01.012816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.019088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 227/448] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:01.022998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.137824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a801-b4d8-4a79-819d-8198c5e837e0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.149719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be29bb-01c1-46ee-a43f-7550d084d89e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.163186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:01.178054 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.178919 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.179280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.179561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] PATH_INFO: `/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.180742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] RBAC: Authorizing `identity:get_project(project_id=c8f8bcbe7c20482ea2f11baadd886fe4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.182189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.183909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 222/449] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/projects/c8f8bcbe7c20482ea2f11baadd886fe4 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:01.188661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.189217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.189313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.189591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.189879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.248472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:01.259320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.260783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.286007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c06a9-1412-4d8c-b56e-65b27bb78b0c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.321118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.321970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.322262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.322544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] PATH_INFO: `/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.323750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] RBAC: Authorizing `identity:get_group(group_id=9501d4c4c6e249cab7dda9761b43c6a3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.325189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.326808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 223/450] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/groups/9501d4c4c6e249cab7dda9761b43c6a3 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:01.332597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.361765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 228/451] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:05:01.367732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.390506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:01.441738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3e4b-733f-45d0-b352-7e804dcc3296 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.460389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:01.469928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54367072-0ac8-46d7-a51d-350255861dc3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.475599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.476251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.476542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.476827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.477656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] RBAC: Adding query filter params (group.id=9501d4c4c6e249cab7dda9761b43c6a3, role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:01.477982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.479448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.485240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 224/452] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/role_assignments?group.id=9501d4c4c6e249cab7dda9761b43c6a3&scope.project.id=c8f8bcbe7c20482ea2f11baadd886fe4&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:01.505672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.506479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.506761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.507092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] PATH_INFO: `/v3/projects/06d95d128265441e8d2bda222376dded` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.508379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] RBAC: Authorizing `identity:get_project(project_id=06d95d128265441e8d2bda222376dded)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.509896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.511722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 229/453] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/projects/06d95d128265441e8d2bda222376dded => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:01.517419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.630005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a8756-6da4-4836-8b56-d957ad2ff4b3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.649334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:01.666293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938b29a-83ba-47d5-83a9-15d110e1499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.667267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b29a-83ba-47d5-83a9-15d110e1499e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.667738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b29a-83ba-47d5-83a9-15d110e1499e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.668241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938b29a-83ba-47d5-83a9-15d110e1499e None admin] PATH_INFO: `/v3/groups/0ef09ba3c2ad4d89b57692db48b5cf6b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.670756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b29a-83ba-47d5-83a9-15d110e1499e None admin] RBAC: Authorizing `identity:get_group(group_id=0ef09ba3c2ad4d89b57692db48b5cf6b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.672234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938b29a-83ba-47d5-83a9-15d110e1499e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.673873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 225/454] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/groups/0ef09ba3c2ad4d89b57692db48b5cf6b => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:01.680566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:01.783668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d406f-fe22-4646-9e93-a0d97687a7ad None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:01.818361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:01.819026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:01.819344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:01.819623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:01.820453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] RBAC: Adding query filter params (group.id=0ef09ba3c2ad4d89b57692db48b5cf6b, role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=06d95d128265441e8d2bda222376dded) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:01.820772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:01.822201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eada9-67db-466a-91fe-ed5221e1bf87 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:01.828295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 230/455] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jun 29 11:05:01 2022] GET /identity/v3/role_assignments?group.id=0ef09ba3c2ad4d89b57692db48b5cf6b&scope.project.id=06d95d128265441e8d2bda222376dded&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:04.351669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fc1e-3687-4ef5-a2dc-9633cd286552 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.352191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fc1e-3687-4ef5-a2dc-9633cd286552 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.352302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fc1e-3687-4ef5-a2dc-9633cd286552 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.353829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 226/456] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:04.358683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.359101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.359287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.379383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:04.380683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:04.398674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:04.469599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 231/457] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:04.495279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec01fb-fbfc-467a-a4b1-9b1a3bf2e75c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.495563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec01fb-fbfc-467a-a4b1-9b1a3bf2e75c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.495923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec01fb-fbfc-467a-a4b1-9b1a3bf2e75c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.497284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 227/458] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:04.498375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:04.502415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378ab4-2b74-4718-9272-d8f888ada9ce None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.502698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378ab4-2b74-4718-9272-d8f888ada9ce None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.502978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378ab4-2b74-4718-9272-d8f888ada9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.530113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-05378ab4-2b74-4718-9272-d8f888ada9ce None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:04.531319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-05378ab4-2b74-4718-9272-d8f888ada9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:04.638453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 228/459] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:04.639808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197771-6e80-4fe9-b40d-33dc09e19ba5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.640101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197771-6e80-4fe9-b40d-33dc09e19ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.640443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197771-6e80-4fe9-b40d-33dc09e19ba5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.642095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 229/460] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:04.647874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.648398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.648878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.667725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b42d5d-4fdf-4d2a-ab70-d2cd034210fe None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:04.670517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:04.671741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:04.710250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:04.712341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.712860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.713341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.726940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:04.729085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:04.744693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 230/461] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:05:04.745839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:04.752039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:04.752927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:04.753771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:04.753771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:04.753771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:04.753771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:04.753771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 232/462] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:04.761122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:04.767393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:04.813946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:04.873799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57790dd-6ce4-4ca9-9749-a4c337039aaa None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:04.888891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263187d6-e30f-46cb-b746-b89bba67fae8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:04.911833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:04.912636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.913348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.913641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.924244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:04.925721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:04.928537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:04.929321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.929611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.929894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.930617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:04.930929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:04.932323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-46e87064-ef52-4ff5-b179-32e374f66e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:04.945748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:04.946671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:04.947904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:04.947904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:04.947904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:04.947904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:04.948125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 233/463] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:04.948125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:04.949590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 231/464] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:04.952709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2e4b-2b63-4d2b-8f35-9647e11400b3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:04.953294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2e4b-2b63-4d2b-8f35-9647e11400b3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:04.953873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2e4b-2b63-4d2b-8f35-9647e11400b3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:04.955605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 232/465] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:04.956525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2e4b-2b63-4d2b-8f35-9647e11400b3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.017487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:05.059023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4b524-13b6-4049-9b3e-5f039d518068 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.067952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:05.072265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2e4b-2b63-4d2b-8f35-9647e11400b3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.096093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.096985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.097408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.097649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.109031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.109166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839146ed-2485-4a91-9cfb-3d954c08e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.109803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839146ed-2485-4a91-9cfb-3d954c08e9dc None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.110090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839146ed-2485-4a91-9cfb-3d954c08e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.110369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839146ed-2485-4a91-9cfb-3d954c08e9dc None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.110525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.111109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839146ed-2485-4a91-9cfb-3d954c08e9dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.112540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839146ed-2485-4a91-9cfb-3d954c08e9dc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:05.131449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:05.132321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:05.133219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:05.133219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:05.133219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:05.133219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:05.133219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 234/466] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:05.133501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.143085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 233/467] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:05:04 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:05.144307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.144608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.144887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.171996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:05.174207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:05.263085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bf117-e3b3-4f7d-84a0-2dbd61b5beb3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.277527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 234/468] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:05.278793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.289601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:05.318825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.319874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.320168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.320461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.321175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:05.321490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.322881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.337064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 235/469] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:05.337281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.386322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:05.403082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe823-c715-48f7-919c-d3b0861fbd0a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.449935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.450772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.451227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.451608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.452562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:05.452973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.454687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.462998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba0ac2-acea-4555-bb48-7ff8e78dd159 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.474835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 235/470] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:05.475880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.505269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.506131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.506417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.506742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.518155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.519659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:05.538190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:05.539137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:05.540000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:05.540000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:05.540000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:05.540000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:05.540000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 236/471] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:05.540682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.575546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:05.596721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54605f3-74cc-4ea7-9111-01af90e51c6b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.636134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.636820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.637109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.637387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.638106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.639765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.651704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163d20a-2880-4ccf-a919-34eaf25cf423 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.665742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 236/472] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:05:05 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:05.666722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.669735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:05.715074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.715772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.715772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.715961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.716759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.718401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.787071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 237/473] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:05:05 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:05.800336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929aae68-ef48-40d4-bf63-56d8ea8f15f3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:05.857790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:05.858763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.859228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.859717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.860652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:05.861106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:05.862770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ff1bf-c717-42ac-8df3-794b68ab3743 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:05.876703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 237/474] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:05.888688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:05.903703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d330e6-f6ff-4d83-a5e6-06d48006a457 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.904001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d330e6-f6ff-4d83-a5e6-06d48006a457 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.904275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d330e6-f6ff-4d83-a5e6-06d48006a457 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.905784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 238/475] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:05.913668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:05.913668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:05.913907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:05.933802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:05.934944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:06.001117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:06.009531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:06.016501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 239/476] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:06.032442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000385c-0ac0-4ed6-8311-ed3d4c55f252 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:06.044034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:06.074409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:06.075129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:06.075426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:06.075711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:06.076436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:06.077894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:06.102072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 238/477] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:05:05 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:06.171537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0db8ec-fac4-45ee-9c87-3d99bbc68f11 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:06.216307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:06.217294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:06.217836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:06.218292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:06.219279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:06.220958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:06.235033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.sql.core [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 11:05:06.235033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 11:05:06.235033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [parameters: {'id': '03484ad5892e4cb7bc49c5da3709ef79', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 11:05:06.235033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80058) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() Jun 29 11:05:06.252253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 11:05:06.253199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application yield resource Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise self.value Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application session.commit() Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 11:05:06.255089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.flush() Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application compat.raise_( Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 11:05:06.256260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 11:05:06.257158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 11:05:06.257985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [parameters: {'id': '03484ad5892e4cb7bc49c5da3709ef79', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:06.264009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 11:05:06.265978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:06.267982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 240/478] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jun 29 11:05:06 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:06.268117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:06.374399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400969ea-349a-4ce4-ab1f-a68e913f10c3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:06.409828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd89d2-3fba-4173-92a3-ff366cc425d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:06.410651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd89d2-3fba-4173-92a3-ff366cc425d9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:06.410984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd89d2-3fba-4173-92a3-ff366cc425d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:06.411302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd89d2-3fba-4173-92a3-ff366cc425d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:06.419939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:06.427009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd89d2-3fba-4173-92a3-ff366cc425d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-15fd89d2-3fba-4173-92a3-ff366cc425d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:06.439128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:06.440847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:06.442815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 239/479] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:06.446786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:06.511626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:06.559600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829813-b6b7-43ff-a584-7175aaa083ce None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:06.605106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:06.606124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:06.606610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:06.607125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:06.608111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:06.608635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:06.610217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fc6e6-8228-41e5-b76e-92449dd45fe7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:06.620336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 241/480] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:07.575284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517d18b-dc24-4b91-b48d-c5f85601a48a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:07.575824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517d18b-dc24-4b91-b48d-c5f85601a48a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:07.575824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517d18b-dc24-4b91-b48d-c5f85601a48a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:07.577472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 240/481] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:07.582554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:07.583545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:07.583732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:07.610353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:07.611625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:07.712178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 242/482] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:07.744509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517d18b-dc24-4b91-b48d-c5f85601a48a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:07.880724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517d18b-dc24-4b91-b48d-c5f85601a48a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:07.932038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:07.932832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:07.933117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:07.933397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:07.954659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:07.962453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:07.963467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:07.964261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 241/483] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:07.973787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:08.075383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:08.150861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54a9b0-c100-453e-846d-c90ea684620f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:08.198564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:08.199273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.199563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.199845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.200601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:08.200916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:08.202316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:08.211297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 243/484] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:08.220368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:08.324103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:08.381574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501b56-b0ac-46a3-9f58-e60ed5b9c4c3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:08.429895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:08.430606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.430894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.431200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.447401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:08.448852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-668c61d6-3877-494e-b7b3-0077951e1c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:08.470624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:08.471508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:08.472331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:08.472331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:08.472331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:08.472331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:08.472331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 242/485] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:08.479056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:08.574443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6ea0-bca2-47a5-b582-6e5cafc8c8f2 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.574812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6ea0-bca2-47a5-b582-6e5cafc8c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.575009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c6ea0-bca2-47a5-b582-6e5cafc8c8f2 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.576644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 243/486] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:08.584512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.584802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.585080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.610903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:08.612462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:08.692825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04519e7-7185-4465-b479-e9243320dfd6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:08.712379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 244/487] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:08.714626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:08.740360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:08.741374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.741926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.742425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.743469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:08.743980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:08.745615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc0d27-6ebd-4528-a20a-9899e9d54c4e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:08.758546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:08.764592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 244/488] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:08.766006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3c74-5b8f-4f25-81d9-555cca196e86 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.766293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3c74-5b8f-4f25-81d9-555cca196e86 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.766570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c3c74-5b8f-4f25-81d9-555cca196e86 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.768244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 245/489] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:08.775087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.775087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.775087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.791687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:08.792869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:08.807823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:08.868237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537b37f-d8f9-4016-a8eb-eb5b05bf371e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:08.871087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 246/490] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:08.871087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:08.911712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc65bd-8b83-4c28-b284-db36009fc273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:08.912510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc65bd-8b83-4c28-b284-db36009fc273 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.912799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc65bd-8b83-4c28-b284-db36009fc273 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.913079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc65bd-8b83-4c28-b284-db36009fc273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.923448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc65bd-8b83-4c28-b284-db36009fc273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-40fc65bd-8b83-4c28-b284-db36009fc273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:08.931414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:08.932308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:08.933116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 245/491] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:08.934243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c54b9c-a71f-4062-958e-2262141f5256 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:08.934243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c54b9c-a71f-4062-958e-2262141f5256 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:08.934398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c54b9c-a71f-4062-958e-2262141f5256 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:08.935848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 246/492] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:08.936474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c54b9c-a71f-4062-958e-2262141f5256 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:08.994631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8473b-86cf-4565-aba8-6fe335fbf8e2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:08.998230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.036327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.037270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.037630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.037913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.045586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.047054 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.051632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c54b9c-a71f-4062-958e-2262141f5256 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.053744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:09.064446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:09.065368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:09.066286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 247/493] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:09.066846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.090532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8afd30-ebf0-48ff-97a2-e3bbebd99e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.091362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8afd30-ebf0-48ff-97a2-e3bbebd99e0e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.091656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8afd30-ebf0-48ff-97a2-e3bbebd99e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.091941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8afd30-ebf0-48ff-97a2-e3bbebd99e0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.102505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8afd30-ebf0-48ff-97a2-e3bbebd99e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fa8afd30-ebf0-48ff-97a2-e3bbebd99e0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:09.110219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:09.111109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 247/494] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:09.116975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.117764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.117764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.133154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:09.134332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:09.179729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677d6dd-88b1-406f-89f6-27ef7db256ae None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.205962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 248/495] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:09.206799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.220815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.221477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.221772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.222035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.222774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:09.223115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.224520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.232698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 248/496] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:09.233617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.258986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.301904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.312354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c43864-fbce-4e7c-91e2-f196dcc52d95 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.340675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6347505-1b71-4cde-b9dc-5f857ae47229 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.352433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.353106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.353387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.353664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.354490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:09.354798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.356294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.373924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.374606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.374890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.375207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.375947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:09.376257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.377629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421715f1-2b29-429e-a010-482c64b8959d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.386112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 249/497] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:09.387403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf3832-a95e-44fd-9b9c-61972892b9c1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.387696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf3832-a95e-44fd-9b9c-61972892b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.387977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf3832-a95e-44fd-9b9c-61972892b9c1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.389352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 250/498] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:09.389939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf3832-a95e-44fd-9b9c-61972892b9c1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.399410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 249/499] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:09.399410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.472518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.489856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf3832-a95e-44fd-9b9c-61972892b9c1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.495245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9d8ca-8612-4231-bb17-d5915d69d324 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.523864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.524669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.524967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.525244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.529426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.530215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.530500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.530779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.535294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:09.540534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.541972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:09.543064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:09.544006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:09.544792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 251/500] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:09.545446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-211bbd97-5d2e-42a1-a179-1aa262bf8928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:09.562771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:09.563728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:09.564573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:09.564573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:09.564573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:09.564573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:09.564573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 250/501] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:09.565125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.565415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.565693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.571029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.583523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:09.584698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:09.647712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67c4af-97be-41cc-82b1-c4ef4740e353 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.652735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 251/502] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:09.653575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.681855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.682648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.682936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.683246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.695226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.696946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.699645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:09.714669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:09.715555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:09.716410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:09.716410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:09.716410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:09.716410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:09.716410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 252/503] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:09.716793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.768679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68faf82-bccf-4b08-8bf6-b9e7812e84b6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.797632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.803947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.804595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.804882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.805161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.818126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bd9b2-86f6-4fe9-9aa5-21af2b6b4c82 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.851804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:09.852471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:09.852756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:09.853039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:09.853787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:09.854098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.855509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.863439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 253/504] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:09.864789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:09.872954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:09.874405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:09.921030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:09.963879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655ba99-03e4-4fa7-8bf6-13442366810a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:09.978251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 252/505] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:09.979089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.005674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.006335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.006619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.006896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.007644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:10.007952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.009157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.009337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.021687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 254/506] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:10.022469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.082111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730e09f-ef3c-452b-aa83-014b1ba1e5b8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.116649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.117444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.117727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.118004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.122166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aff41b-148c-44e5-9fcc-02fe5de79411 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.127950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.129385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.139519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:10.147451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:10.148443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:10.149332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:10.149332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:10.149332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:10.149332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:10.149332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 253/507] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:10.149588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.159762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.160423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.160768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.161576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.162305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:10.162614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.164023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.181694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 255/508] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:10.182498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.240268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.255981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19a10a-5fe0-4a94-a08a-8b0e3d439b77 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.278773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b3fb5-4af8-4fa2-a34b-6ce3f942b21c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.289703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.290480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.290764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.291061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.303609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.305087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.315551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.316470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.316759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.317074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:10.323495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:10.324478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:10.325769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:10.325769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:10.325769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:10.325769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:10.327179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 254/509] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:10.328187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.329534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.331764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:10.351436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:10.352449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:10.353409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:10.353409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:10.353409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:10.353409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:10.353409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 256/510] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:10.353409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.384171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.430330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d73f5e-489d-495c-bc5e-f3f52a67d0cb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.453890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd96005-d8fe-42ba-acac-285192f0ad3f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.464103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.464889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.465172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.465449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.468134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.472986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.475131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.487315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.487972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.488266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.488552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.489305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:10.489620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:10.490860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:10.491898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:10.492826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:10.493342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.493409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 255/511] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:10.493409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.503994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 257/512] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:10.505332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.593612 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e72712-1f03-4741-b40d-6fecbee0eee0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.594125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.604362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f04dbf-3282-49fe-bb07-da0390895594 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.626927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.627766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.628057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.628338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.635945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.637402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.637605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.638262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.638552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.638831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.639594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:10.639908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.641278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:10.652272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:10.653233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 11:05:10.654112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:10.654623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 258/513] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:10.654623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.657348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 256/514] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:10.658329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.713540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.756721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f3bb-7b4a-47ed-8440-59b90d65eeb7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.757343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec7b2-dde8-4aa9-ab3f-d6594f18b3e2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.789934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.790585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.790725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.790869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.791163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.791415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.791701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.791877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:10.791986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.792185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.792784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:10.793093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.793556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.794508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.807242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 259/515] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:10.808001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.815852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 257/516] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:10.815852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.824985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.910697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c86d1-c8cb-495d-b996-d3292dc54c0f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.911470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60977f26-9ad3-4d3d-8c65-9d8687fd597d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:10.924457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:10.946041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.946205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:10.946699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.946879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:10.946975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.947227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:10.947315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.947511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:10.947966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.949393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.954453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:10.955904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:10.969236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 260/517] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:05:10 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:10.970014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:10.971375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:10.972273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:10.973207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 258/518] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:10.973819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.053078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.096016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5863c-f029-4590-91fa-3b2270baae46 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.110909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68eb51-0824-4bf9-89ca-1d9c28f97056 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.137061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.138409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.138409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.138722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.141251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:11.141251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.142149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.151100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.151931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.152217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.152495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.161961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.163397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:11.179883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:11.180777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:11.182036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 259/519] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:11.182504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 261/520] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jun 29 11:05:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:11.182573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.182638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.226341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.289174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6b2ca-7fe4-427d-90f6-011e8ff47881 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.301939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8425b-ac4e-4f86-a093-33a9c3430732 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.313158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.328273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.329067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.329480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.329761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.330609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:11.330926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.332715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.339799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.340452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.340738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.341016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.356624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 262/521] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:11.356624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.415136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.416625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.452325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.463214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7c7a7-581e-40e4-ab80-154d7d1c89f7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.505503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.506253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.506611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.506970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.507819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:11.508138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.509587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.525283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 260/522] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:11.526408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.538119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 263/523] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:11.538119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.580718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.637070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d81f-b551-4fbd-b1e5-9259e923df86 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.638389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a146e-e3ee-4ca7-8091-dde569622bd2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.676003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.676188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:11.676609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.676777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:11.676933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.677035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:11.677181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.677280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:11.680122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.748892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.750380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.755113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:11.756824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:11.797789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.859504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 264/524] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:11.860335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.882296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 261/525] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:11.882296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:11.915598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:11.969673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb437e-6119-491e-ab7c-6106d14ababb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:11.983843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad89cb-edd4-47cc-ab2a-613a18938adf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.015737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.016637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.016932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.017223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.020770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.021435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.021725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.022005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.022847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=012fd3c15c444f5a8519f1b44fbcd5b7) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:12.023191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.024642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.028601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.030136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.043242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 262/526] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/role_assignments?user.id=012fd3c15c444f5a8519f1b44fbcd5b7&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:12.043242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.045128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:12.065769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:12.066700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:12.068221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:12.068221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:12.068221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:12.068221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:12.068221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 265/527] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:12.068494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.167939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.174448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258281f5-710f-425b-93b2-b64e94d841aa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.203022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e1603-7048-4836-af3a-55d2a99cf306 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.214773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.215977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.216403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.216889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.229652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.231929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.243284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.244206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.244599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.244981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:12.254041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:12.255641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:12.256698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:12.256698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:12.256698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:12.256698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:12.258118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.259031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 263/528] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:12.260121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.264183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:12.284028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:12.284985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:12.285850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:12.285850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:12.285850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:12.285850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:12.290355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 266/529] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:12.291412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.344968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.395801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a28b1-b00c-461b-b1dc-71b682c84189 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.407858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca2d1-99cf-4dcb-a64e-43fe1658c610 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.433564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.434026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.434320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.434604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.435380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:12.435695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.437231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.446547 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.447571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.448026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.448464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.449327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:12.449795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.451357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.455238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 264/530] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:12.456123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.465648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 267/531] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:12.466829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.468746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.567809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ccc46-ce30-47f8-97c5-7724950e422b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.576816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c6f2-c7b1-4931-9311-40531da8ffcd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.585223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.603183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.603860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.604151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.604428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.605157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:12.605472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.606847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.617233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.618271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.618738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.619264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.619895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 265/532] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:12.620914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.628082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.630505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:12.647901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:12.648799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:12.649652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:12.656522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:12.657824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.694262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.727818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b105075-d114-4630-ad60-8543a0d6a671 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.763345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.764168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.764444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.764724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.771769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.772565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c556b06-5ab5-49b7-bd4b-3f8840ba3634 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.773220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:12.788269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:12.789144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:12.789985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 266/534] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:12.790972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.821326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.822871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.823518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.824001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.831911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.833825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:12.857434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:12.858318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:12.859731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:12.865102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 269/535] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:12.865102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:12.904694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f3bc0-194c-4dde-8224-c353369df9b2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:12.911469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.937989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:12.945105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:12.945775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:12.946068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:12.946353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:12.947297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:12.947618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:12.949193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:12.968832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 267/536] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:12.969956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:13.001456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56006ba-41bd-4dcc-8282-edb465d8216c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.046975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.047848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.048139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.048419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.049710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:13.050309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:13.052825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:13.072238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 270/537] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:13.072812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:13.084157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb13d9-d4ad-4d5b-b960-397d0ef07f9c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.121176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.121840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.122129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.122411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.123256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:13.123560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:13.124975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302d8c9-bac2-41b0-8077-2f595b035db8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:13.136657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 268/538] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:13.141721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70902-3795-4a5c-9651-97d6862848e3 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.141721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70902-3795-4a5c-9651-97d6862848e3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.141721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d70902-3795-4a5c-9651-97d6862848e3 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.141721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 269/539] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:13.141721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70902-3795-4a5c-9651-97d6862848e3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:13.172158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:13.192873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54700730-102e-4700-b1cd-07209d1dc490 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.194748 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:13.231058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.231730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.232016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.232296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.233132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=14b23668139e429bacd32a5d4fc0994e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:13.233452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:13.235350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:13.243249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 271/540] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:13 2022] GET /identity/v3/role_assignments?user.id=14b23668139e429bacd32a5d4fc0994e&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:13.244039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:13.275065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d70902-3795-4a5c-9651-97d6862848e3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.314536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.315288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.315578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.315866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.316708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=adcb515e83b3484f9e93e18497fbbdfd) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:13.317632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:13.319134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335ada5-b929-4e80-8b56-b6cecb3284ed None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:13.325631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 270/541] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:13 2022] GET /identity/v3/role_assignments?user.id=adcb515e83b3484f9e93e18497fbbdfd&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:13.332712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10378-e650-4113-9319-403201b61d9b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.333049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10378-e650-4113-9319-403201b61d9b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.333281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10378-e650-4113-9319-403201b61d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.372283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f9e10378-e650-4113-9319-403201b61d9b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:13.373531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f9e10378-e650-4113-9319-403201b61d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:13.389549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42734d53-55ec-4a9a-9441-2a3e9bb70ea4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.432165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.433739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.434231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.434708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.436074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=f69233ef76fb44b78ac88a111c883182) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:13.436628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:13.438664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:13.447964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 272/542] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:13 2022] GET /identity/v3/role_assignments?user.id=f69233ef76fb44b78ac88a111c883182&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:13.512762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 271/543] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:13.555423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:13.575428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:13.674860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72401457-7744-4133-81e1-37cdb9e9bc72 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.717620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.718789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.719308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.719815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.733970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:13.742278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:13.743178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:13.743982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:13.753269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 273/544] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:13.759253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e10378-e650-4113-9319-403201b61d9b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:13.851471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:13.899684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e10378-e650-4113-9319-403201b61d9b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:13.936858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:13.937464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:13.937755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:13.938036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:13.938785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:13.939124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:13.940508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:13.950380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 272/545] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:13.956020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:14.062387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:14.096989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2caee-2d22-46c0-b33f-7ed38967a597 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:14.148910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:14.149716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:14.150006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:14.150284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:14.169019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:14.170545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-29414eb7-c5f2-4f84-8a61-aebf994708f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:14.211886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:14.212805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:14.213690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:14.213690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:14.213690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:14.213690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:14.213690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 274/546] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:14.220003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:14.352908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44488424-2836-43b0-9798-e96262791eea None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:14.353251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44488424-2836-43b0-9798-e96262791eea None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:14.353537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44488424-2836-43b0-9798-e96262791eea None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:14.355171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 275/547] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:14.360435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:14.360728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:14.361007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:14.381481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ab2d3-344c-4c5d-bf1a-868c4693b2d0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:14.392018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:14.393214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:14.396011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:14.447879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:14.448548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:14.448837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:14.449116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:14.449841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:14.450152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:14.451560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:14.475677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 273/548] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:14.481175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:14.520436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 276/549] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:05:14.558140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:14.651249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755a48-05cf-4173-9203-20d4494d6332 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:14.659387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:14.714082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:14.714895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:14.715207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:14.715486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:14.727814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:14.729192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:14.733152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac17bec-cb97-4a74-ae61-e33fc733eba2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:14.757450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:14.758885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:14.760417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 274/550] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:14.769694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:14.797917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:14.798716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:14.798996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:14.799293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:14.818159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:14.819347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:14.833872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:14.836133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:14.838042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 277/551] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:14.842011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:14.962264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0aa256-3299-4cd9-9023-8adb6599c786 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:14.982326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1617a5-20b0-4285-a977-c55846a23c52 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:14.998681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:15.037043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.038387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.039364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.040290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.041633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:15.042442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.044533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.045344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.046267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.046792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.047281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.049634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:15.050165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.053150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.066038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 278/552] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:15.068031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:15.090646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 275/553] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jun 29 11:05:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:15.096158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:15.194579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:15.209294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3a0f-34c7-4654-8a0f-c013d8e3369f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:15.273825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.275064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.276119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.276769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.278735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98957a-a6db-4cf1-9cab-176035566052 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:15.357496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.358672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.359438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.360947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.383806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.385134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.385455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.387160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:15.420857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:15.421782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:15.422676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:15.422676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:15.422676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:15.422676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:15.430138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 279/554] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:15.437813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:15.481241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:15.546968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:15.580170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 276/555] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 11:05:15.586438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:15.608929 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888d2b2-543a-40ea-a0b8-8c2a28c7b591 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:15.644420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.646004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.646495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.646970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.647955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:15.648514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.650083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.663072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 280/556] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:15.668828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:15.783170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13b6f7-9463-4a77-8524-f5a45cdbe044 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:15.812457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:15.821215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.822366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.822816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.823269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.824664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737371d-84a8-46c1-8ddf-16ed044b1e3e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:15.837485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.838931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-99b5eee2-2da4-4101-9912-a1dc3a416249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:15.856765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:15.858107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:15.858969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:15.858969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:15.858969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:15.858969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:15.858969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 277/557] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:15.859826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c83484-b720-4d35-a9a6-addcbe47fd46 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.859895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c83484-b720-4d35-a9a6-addcbe47fd46 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.860171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c83484-b720-4d35-a9a6-addcbe47fd46 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.861567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 278/558] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:15.862628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf6615-cc27-4d55-8c6f-c366264a0abc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.862921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf6615-cc27-4d55-8c6f-c366264a0abc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.863228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf6615-cc27-4d55-8c6f-c366264a0abc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.864645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 279/559] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:15.867921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf6615-cc27-4d55-8c6f-c366264a0abc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:15.872358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:15.873238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.873525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.873804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.882899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:15.884402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f1d3b95e-b91a-40a6-9716-ffa61285bf6f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:15.899359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:15.900584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:15.901524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 281/560] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:15.902157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1ff74-9962-4b58-8b58-7e948b37b11d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.902358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1ff74-9962-4b58-8b58-7e948b37b11d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.902644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1ff74-9962-4b58-8b58-7e948b37b11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:15.915132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:15.921658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-57d1ff74-9962-4b58-8b58-7e948b37b11d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:15.923216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-57d1ff74-9962-4b58-8b58-7e948b37b11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:15.984918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf6615-cc27-4d55-8c6f-c366264a0abc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:15.989902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 282/561] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:15.989902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d12c-d816-47e6-99b1-7e9ddfdbb656 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:15.990408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d12c-d816-47e6-99b1-7e9ddfdbb656 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:15.990508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d12c-d816-47e6-99b1-7e9ddfdbb656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.006846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-31e9d12c-d816-47e6-99b1-7e9ddfdbb656 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:16.008048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31e9d12c-d816-47e6-99b1-7e9ddfdbb656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:16.032512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.033180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.033476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.033760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.034487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:16.034803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.036230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.051585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 280/562] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:16.051585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.074997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 283/563] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:16.076388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d03c4-101b-4c7b-aa80-ec4ae9964005 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.076686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d03c4-101b-4c7b-aa80-ec4ae9964005 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.076962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d03c4-101b-4c7b-aa80-ec4ae9964005 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.078203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 284/564] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:16.078886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d03c4-101b-4c7b-aa80-ec4ae9964005 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.097318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.154922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.161281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fdce16-69b5-4455-b23e-3626d654102e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.186376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d03c4-101b-4c7b-aa80-ec4ae9964005 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.195022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.195730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.196022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.196307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.197139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:16.197455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.198876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.216844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 281/565] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:16.217673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.227235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4961fad-c6fd-4da8-b892-0c6e32158d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.228032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961fad-c6fd-4da8-b892-0c6e32158d03 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.228320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961fad-c6fd-4da8-b892-0c6e32158d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.228604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4961fad-c6fd-4da8-b892-0c6e32158d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.239628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4961fad-c6fd-4da8-b892-0c6e32158d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a4961fad-c6fd-4da8-b892-0c6e32158d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:16.247341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:16.248383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:16.249259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 285/566] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:16.249972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.249972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.250331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.266532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:16.267740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:16.322124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da8f03-6bd8-469b-96cf-cdbb207ec41b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.331767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.337099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 286/567] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:16.337903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.358726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.359558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.359839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.360119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.367390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.368809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:16.382735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:16.383864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:16.384752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 282/568] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:16.386116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.401769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.436430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b590b5-550b-45a5-b825-c6ecbd0e96e9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.469418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.470217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.470502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.470779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.481271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:16.486587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335896cc-3d68-429a-96e1-e4a5fe07b8db None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:16.489545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:16.490603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:16.491670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 287/569] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:16.492384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.522201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.522994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.523317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.523600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.534735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.536736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.549752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:16.554756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:16.555715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:16.556596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:16.556596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:16.556596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:16.556596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:16.556596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 283/570] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:16.556876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.595685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b730-f930-4748-9109-fedb062e1094 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.621412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.629319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.629982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.630271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.630550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.631318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:16.631629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.633007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.640737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 288/571] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:16.641585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.656976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1636-3516-46e4-820d-37bfa114991e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.691162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.691997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.692288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.692575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.702772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:16.710581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:16.711760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 284/572] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:16.712727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.743862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49e6e8-adf0-4010-808a-8fea7efd9e6d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.765239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.777652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.778335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.778630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.778912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.779726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:16.780041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.781478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.793750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 289/573] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:16.794645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.814332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2848b47-fff4-467c-95c7-35658251c0c8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.839186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:16.848816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.849423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.849706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.849979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.850710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:16.851012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.852432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.860398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 285/574] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:16.865542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.892575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e86ea-3f53-41e5-97e1-a7329d52081b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.926169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:16.926903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:16.927215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:16.927755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:16.928477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:16.929404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:16.930149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:16.941361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 290/575] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:16.942144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:16.962781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ea8db-a39f-43cb-9cfc-cc075a132ac2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:16.984305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.000990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.001588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.002077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.002431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.015978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.017416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:17.034833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:17.036326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:17.037202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:17.037202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:17.037202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:17.037202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:17.037202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 286/576] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:17.037471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.050770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd542cfb-e944-4fb6-a81c-458a13f29286 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.078096 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.084273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.084932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.085215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.085491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.086226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:17.086536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.087937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.095793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 291/577] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:17.096395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.139542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966990a-c893-4b2b-8156-dcafb12e2537 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.173044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.173710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.173970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.174248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.175071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=45862644baba4528bd6dbe4dab092089) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:17.175388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.176823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.182717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 287/578] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/role_assignments?user.id=45862644baba4528bd6dbe4dab092089&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:17.183348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.202718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c848b9-5a1b-4710-9af7-45595def6d43 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.205405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.244151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.244962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.245242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.245513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.257924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.259453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:17.279780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:17.280798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:17.281680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:17.281680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:17.281680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:17.281680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:17.281680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 292/579] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:17.282661 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.308890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaea0d1-2bfe-4664-b373-727011311d2d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.311440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.350181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.351135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.351515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.351781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.365552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.368321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:17.388284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:17.389216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:17.390156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:17.391442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 288/580] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:17.392272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.405603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce37cc-b887-4fb0-bc2f-18979d4fa287 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.444173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.444847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.445120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.445403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.446123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:17.446434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.448021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.464746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 293/581] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:17.465539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.484108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.505399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2575c-617d-4c73-b643-f8eb245fe9f9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.543152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.544094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.544482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.544861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.557809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.559951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.579074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a798-19a7-4d7b-a79b-acc54a1435c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:17.583885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:17.584751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:17.590662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:17.590662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:17.590662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:17.590662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:17.590662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 289/582] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:17.590662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.610791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.620176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.621148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.621445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.621713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.622447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:17.622768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.624205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.640620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 294/583] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:17.640620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.708594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672e8cd-05ea-4132-a10b-9e6fbaba143b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.715191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.739372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36da94a-75e5-478b-a2de-96980897089b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.746288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.747137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.747496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.747847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.748823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:17.749206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.750815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.768567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 290/584] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:17.768567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.778882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.779799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.780087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.780368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.788143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.789584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:17.804817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:17.805822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 295/585] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:17.806803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.856402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.881875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb6ff5-af4f-41aa-9bd0-16dfedc36cec None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.919121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de3e45-e309-4ecc-b2e5-f078bf7d47dc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:17.919458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.920118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.920413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.920696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.922123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:17.922123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.923084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.936018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 291/586] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:17.936780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:17.960910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:17.961705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:17.961992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:17.962267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:17.965056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:17.971208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:17.972901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:17.991933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:17.993166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:17.994338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:17.996529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 296/587] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:17.997559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.064885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6fd86-5db2-4a23-b612-4f4d00f4a4e2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.104893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.106169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.106460 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.106870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/012fd3c15c444f5a8519f1b44fbcd5b7/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.108270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668171a-4791-42ff-a4df-b7567512d73a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.113291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:18.128412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=012fd3c15c444f5a8519f1b44fbcd5b7, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.130000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.143670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 292/588] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:17 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/012fd3c15c444f5a8519f1b44fbcd5b7/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:05:18.144916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.162829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.164121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.164693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.165182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.166295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:18.166910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.168747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.203882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 297/589] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jun 29 11:05:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:18.203882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.276828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:18.286919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224eb8a4-951f-480c-bc96-19b8141e2327 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.335660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.336836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.337130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.337409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.343873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec127b-56ac-4ac9-8bad-716c23afe575 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.347075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.349608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:18.368100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:18.369101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:18.370037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 293/590] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:18.371136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.393681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.394751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.395288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.395763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.396872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:18.397376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.399447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.421325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 298/591] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:18.422477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.448257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:18.529299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7998bf-a3eb-4395-97a0-965f64622120 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.538560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6942b-7577-4bdb-92cf-a5fd938960f4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.554696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:18.582342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.583218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.583507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.583779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.585289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.586122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.586541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.586954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.587962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:18.588427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.589994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.595560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.597045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.609901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 299/592] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:18.611640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:18.621527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:18.622646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:18.623814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:18.623814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:18.623814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:18.623814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:18.623814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 294/593] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:18.624119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.735854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4b3cf-85d7-4fac-9ceb-dd4e9fba6772 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.760269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcd337-c957-42b2-9c17-92a19cad30ce None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.771458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:18.775788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.776830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.777277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.777703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.792335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.794095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.803489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:18.804203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:18.804500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:18.804784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:18.817396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:18.818553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:18.819437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:18.820326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:18.820326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:18.820326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:18.820326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:18.820546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:18.822574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 300/594] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:18.823752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:18.841519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:18.842598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:18.843580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:18.843580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:18.843580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:18.843580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:18.844307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 295/595] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:18.845087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:18.862610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:18.965223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c2e16-15f7-45d4-9d9c-7576d4d66ebe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:18.970455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23784854-a47b-47f1-8181-f9f18393c4c7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.014534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.015750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.016485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.016946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.018568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:19.019080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.022171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.026224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.026976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.027369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.027739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.028545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:19.028931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.030378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.037258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 301/596] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:19.038944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.044516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 296/597] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:19.045284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.060040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.149172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.163570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65aec3-5bd6-4466-b48e-4e89c017b0b7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.173001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb66b1cd-1366-4a58-a90b-5e36b48922b4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.201602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.202789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.203297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.203803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.212338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.214138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.218906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.219705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.220065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.220407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.221198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:19.221576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.223873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:19.231475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:19.232362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:19.233256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:19.235819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 297/598] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:19.236512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 302/599] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:19.237234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.244921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.317447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.355977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895910c0-3a23-49c2-b792-c333beb083c4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.356281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45014a3-34da-4320-bb06-0bda2f4e4ed9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.394625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.395986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.396274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.396554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.399768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.400838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.401412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.401894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.403586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.405498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.411383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.412876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:19.420972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:19.421944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:19.422839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:19.427292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 298/600] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fb27e638-4848-41e5-90a2-c0d28f20ded8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:19.428180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:19.429276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:19.431648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:19.433916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.434179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 303/601] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:19.434179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4d17-1d09-4a03-8cea-85a289eab0a8 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.434179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4d17-1d09-4a03-8cea-85a289eab0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.434179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4d17-1d09-4a03-8cea-85a289eab0a8 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.434179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 304/602] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:19.434179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4d17-1d09-4a03-8cea-85a289eab0a8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.437319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.538851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7c805-a76f-4d91-8bba-9833ad7cc5c9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.545405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4d17-1d09-4a03-8cea-85a289eab0a8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.566268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.573239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.573973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.574263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.574542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.575348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:19.575662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.577080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.584175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.584966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.585280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.585556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.586850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:19.587434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.589542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105cee85-9b9f-4117-9d98-0e1dd987b37b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.591296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 299/603] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:19.592215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.612807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 305/604] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:19.612807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.612807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.612807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.628166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:19.629889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:19.685352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.698075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 306/605] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:19.699243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.704636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58e5d-7ab5-4deb-a151-2bd93ca8db6a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.748197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.748951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.749496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.749654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.750480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:19.750868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.752383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.770564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 300/606] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:19.771674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.812922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228d9b5-6436-4e6b-afc9-be13a25441a9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.826913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.848442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.849323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.849606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.849882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/adcb515e83b3484f9e93e18497fbbdfd/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.864908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=adcb515e83b3484f9e93e18497fbbdfd, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.866365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:19.891069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 307/607] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:19 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/adcb515e83b3484f9e93e18497fbbdfd/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:05:19.891069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:19.896869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9caaa8-e0ed-4827-a88c-6390e7c1c218 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:19.929536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:19.949848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:19.951334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:19.952045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:19.952428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/14b23668139e429bacd32a5d4fc0994e/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:19.975779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=14b23668139e429bacd32a5d4fc0994e, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:19.978199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:20.007067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 301/608] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:19 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/14b23668139e429bacd32a5d4fc0994e/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:05:20.007289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024026d-27a4-4736-ac9f-7f882d18a88f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:20.007387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.085197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:20.087348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.087835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.088278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.105284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:20.116643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:20.117926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:20.118930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:20.122244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 308/609] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:20.129103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.180018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:20.184414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5f1c3-c7d3-4131-af69-3007b6023eb9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:20.235476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:20.236701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.237119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.237525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/f69233ef76fb44b78ac88a111c883182/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.254955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=f69233ef76fb44b78ac88a111c883182, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:20.256856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:20.283228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 302/610] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:19 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/f69233ef76fb44b78ac88a111c883182/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:05:20.290669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5562ae3-d4f2-488f-a2d4-f8ff1a98b6b4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:20.293886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:20.366727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:20.367356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.367641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.367919 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.368683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:20.368995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:20.370415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81714896-d210-468e-b00c-e0d6b94feed2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:20.388280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.389366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 309/611] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:20.402639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c120-3c80-4981-b021-e261e40c121a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.402957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c120-3c80-4981-b021-e261e40c121a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.403877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961c120-3c80-4981-b021-e261e40c121a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.405544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 310/612] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:20.416721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.417043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.417291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.449447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:20.450790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:20.526134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6cdb9-07d3-4bb1-bc95-8dcd05b8f2b1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:20.545784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 311/613] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:05:20.570489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.578442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:20.579287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.579578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.579854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.591072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:20.595064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:20.610763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:20.611718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:20.612597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:20.612597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:20.612597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:20.612597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:20.612597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 303/614] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:20.619119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.621879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:20.725216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:20.756937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217bd69-9e07-42f7-9124-4385d511cd2a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:20.760921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549edf53-67f0-42c3-a1d2-b6e97b838ae9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:20.799695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:20.800993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.802016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.802746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.803701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:20.804208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:20.805802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:20.820128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 304/615] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:20.825098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.845256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:20.846164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:20.846456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:20.846735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:20.858036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:20.866863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:20.867968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:20.868786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 312/616] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:20.874012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:20.896894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:20.983319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703894-de1e-4cb4-abd6-11911a7a1cb6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.009175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce412709-7ebe-438c-9864-c00d40a95996 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.026901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.027722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.028015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.028304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.029065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:21.029381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.030859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.041050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 313/617] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:21.046320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.076681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:21.098774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.099618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.100065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.100350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.108866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.110484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:21.126841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:21.127804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:21.128728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 305/618] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:21.134205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.263768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc8528-abcf-4cd2-9847-74a6287d18ce None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.274136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f06f6-e674-45e4-980f-48494185a1f7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.289932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:21.304357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.305409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.305966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.306419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.307670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:21.308215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.309848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.331679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 306/619] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:21.341002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.355934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.356749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.357032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.357307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.387939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.389440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:21.423414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:21.424544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:21.425429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:21.425429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:21.425429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:21.425429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:21.425429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 314/620] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:21.435864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.466523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e49ce-2fd9-4faa-b551-7ded553f865b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.506945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.508240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.508928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.509414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.521198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.522914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:21.544311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:21.545268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:21.546172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:21.546172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:21.546172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:21.546172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:21.548551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 307/621] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:21.556094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.589882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:21.611590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:21.636793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f78a9-d101-4b1d-be5c-19dbf2da7502 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.705318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.705910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.706194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.706475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.707226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:21.707574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.715459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.741526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac679-893e-4d85-8214-c6522c742ba2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:21.743110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 315/622] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:21.745728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.810330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:21.810996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:21.811313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:21.811589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:21.812312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:21.812616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:21.815023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:21.831063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 308/623] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:21.835054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:21.943732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def8d6f-2e0d-4fee-8096-54e726ce401d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.005322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.006130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.006414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.006689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.015454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.017154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:22.034142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:22.035162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 11:05:22.036169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:22.036720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 316/624] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:22.039390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.041492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.042793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:22.061511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ead99d-95be-4a59-a34b-ad648dafccf1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.168873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc91cad-065d-4f87-8adf-fc434b7721e1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.183752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.184571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.184868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.185161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.199240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.200645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.206359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.207399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.207828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.208246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.209331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:22.209791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.211394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.230733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 317/625] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jun 29 11:05:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:22.239209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:22.240299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:22.241401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 309/626] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:22.242995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:22.244328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:22.303635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.374781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874965-c689-4b65-bf30-de0adb6a03f4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.439164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb82cef-e6a1-42c3-8ac3-f5cc7b821fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.439822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82cef-e6a1-42c3-8ac3-f5cc7b821fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.440107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82cef-e6a1-42c3-8ac3-f5cc7b821fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.440385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb82cef-e6a1-42c3-8ac3-f5cc7b821fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.446852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd657-fdcb-4be1-8019-81c67c1e698e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.487766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.488431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.489305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.489586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.490368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:22.490681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.492126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1b48-1520-4cea-ad56-e62e804e5ca7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.503885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 310/627] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:22.505155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf319-3b50-4077-8d4b-9623eb3505db None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.505446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf319-3b50-4077-8d4b-9623eb3505db None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.505728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf319-3b50-4077-8d4b-9623eb3505db None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.510940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 311/628] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:22.510940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552b28-b05f-4222-9aa9-f4c55c1ec439 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.510940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552b28-b05f-4222-9aa9-f4c55c1ec439 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.510940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01552b28-b05f-4222-9aa9-f4c55c1ec439 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.510940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 312/629] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:22.514430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01552b28-b05f-4222-9aa9-f4c55c1ec439 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:22.525458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82cef-e6a1-42c3-8ac3-f5cc7b821fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.527642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb82cef-e6a1-42c3-8ac3-f5cc7b821fe3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.529936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.578427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.626420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01552b28-b05f-4222-9aa9-f4c55c1ec439 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.640108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 318/630] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:22.645886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.646286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.646575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.659995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876df7e-292f-4ca8-91d6-18445ab938c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.661437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876df7e-292f-4ca8-91d6-18445ab938c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.661724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876df7e-292f-4ca8-91d6-18445ab938c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.662000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876df7e-292f-4ca8-91d6-18445ab938c4 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/45862644baba4528bd6dbe4dab092089/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.665200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:22.666428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:22.677039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876df7e-292f-4ca8-91d6-18445ab938c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=45862644baba4528bd6dbe4dab092089, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.678749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876df7e-292f-4ca8-91d6-18445ab938c4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.691812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 313/631] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:22 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/45862644baba4528bd6dbe4dab092089/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:05:22.693166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad758-b03e-4723-8702-fe256ccc7158 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.693466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad758-b03e-4723-8702-fe256ccc7158 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.693748 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad758-b03e-4723-8702-fe256ccc7158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.717128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e98ad758-b03e-4723-8702-fe256ccc7158 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:22.718379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e98ad758-b03e-4723-8702-fe256ccc7158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:22.741967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 319/632] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:22.742852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:22.793193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.806998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 314/633] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:22.808449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441444e-25c6-4245-abd2-832c3e58421d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.808852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441444e-25c6-4245-abd2-832c3e58421d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.809201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441444e-25c6-4245-abd2-832c3e58421d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.810775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 315/634] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:22.815755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441444e-25c6-4245-abd2-832c3e58421d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:22.841591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:22.870085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6abb08-39c9-4567-9c02-8b05b75be42f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.909755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.911215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.911662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.911939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.922526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:22.924004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:22.931947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441444e-25c6-4245-abd2-832c3e58421d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-48549919-bd4f-4c59-81ce-c0f718c0d7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:22.944333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:22.945270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:22.946174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:22.946174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:22.946174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:22.946174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:22.946174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 320/635] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:22.947009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.947009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.947290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.965142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:22.966306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:22.972894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:22.974390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:22.974671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:22.974948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:22.985870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:22.993690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:22.994645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 316/636] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:22.996170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.051066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 321/637] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:23.051066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.063334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.115570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c556f4-b250-4b37-9111-445fff72bdfa None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.119343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.153358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f676a-a068-4397-a273-410a860838a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.154163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f676a-a068-4397-a273-410a860838a4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.154448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f676a-a068-4397-a273-410a860838a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.154725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f676a-a068-4397-a273-410a860838a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.165931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f676a-a068-4397-a273-410a860838a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:23.166895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc56ee-b75c-41a9-8ebf-2e81ed9fb5b5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-516f676a-a068-4397-a273-410a860838a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:23.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:23.174592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 317/638] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:23.175811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f676a-a068-4397-a273-410a860838a4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.211584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.212505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.213635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.213924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.214648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:23.214962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.216369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.229891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 322/639] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:23.231028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.282238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f676a-a068-4397-a273-410a860838a4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.295563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.321579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.322252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.322537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.322815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.323598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:23.324025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.325388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.335238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 318/640] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:23.336048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.336900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32536398-3290-4ffd-85c1-c2c02855d288 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.354933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.373146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.373884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.374146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.374429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.386231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:23.393953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:23.395489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:23.396374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 323/641] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:23.397068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.446634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9054e67-b3b4-41b8-9de9-f21b6d43d307 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.482066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.482746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.483033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.483341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.484079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:23.484397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.485758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.498468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 319/642] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:23.498468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.511444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f4cef-7e9c-4556-84f2-bb89b6689db5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.535322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.547624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.548411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.548696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.548972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.556200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.557639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:23.572349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:23.573293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:23.574218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 324/643] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:23.576131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.610494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a612c-47c3-41a4-8e30-264d7e38429d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.617265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.653462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.654173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.654466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.654776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.666579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.668169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:23.686861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:23.687801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:23.688858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:23.688858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:23.688858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:23.688858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:23.689087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d120f6-94d3-4204-8620-dc7cd242340e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.693217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 320/644] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:23.693828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.725908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.726579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.726891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.727173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.727920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:23.728230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.729605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.737696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 325/645] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:23.738395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.804984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.820238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732850c-efad-4ef1-b40f-68b08c93cff4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.851687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:23.855092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e689ad-35ef-41c4-b984-54f8e22f03ad None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:23.857644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.858456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.858747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.859028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.870650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.872139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:23.890469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:23.891509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:23.892482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:23.892482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:23.892482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:23.892482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:23.893221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:23.893221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:23.893221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:23.893221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:23.893527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:23.893527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:23.894691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:23.896263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 321/646] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:23.897100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:23.907514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 326/647] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:23.912036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.009292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2f44f-065a-4122-b3c1-8ff04ce419c9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.020896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f731e9-8b97-4b52-8c6c-6730466ce639 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.047658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.048555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.049034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.049548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.050583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:24.051147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.053449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.055384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.056167 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.056454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.056732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.064085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.066758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.072604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 322/648] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:24.072747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.072844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:24.089740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:24.090702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:24.091667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:24.091667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:24.091667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:24.091667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:24.091667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 327/649] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:24.091667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.107183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.178096 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5680a9-6ffe-4715-bf50-59bab6cf2304 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.198638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a085b18-47af-4fbc-bc2f-baeb46448cdc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.212143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.213108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.213598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.213950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.214751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:24.215167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.216635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.229202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 323/650] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:24.230094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.239249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.239986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.240359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.240702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.241604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=012fd3c15c444f5a8519f1b44fbcd5b7) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:24.241992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.243807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.249763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 328/651] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/role_assignments?user.id=012fd3c15c444f5a8519f1b44fbcd5b7&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:24.250610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.331444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.366319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.374492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a53699-39f7-4950-89a7-ea63a21ade3f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.402645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d0165-dda5-4ad6-a701-901ac0465f16 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.417044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.418933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.419322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.419669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.429382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.430051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.447865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:24.448415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:24.449351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:24.450313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:24.450873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.450873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.450873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.450873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:24.450873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.456844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.457008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 324/652] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:24.457008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.468026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 329/653] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:24.469138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.585126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80d4be-baa0-4f92-97c6-7dc159c986d2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.594106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82599dbb-9a81-4f1b-a7ff-90053618f78e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.613232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.630114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.630812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.631125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.631542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.632535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:24.632826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.632946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.633634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.633926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.634208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.634318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.637855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.645997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.647477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.655021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 330/654] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:24.655994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:24.664728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:24.665678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:24.666766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 325/655] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:24.667487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.778170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1729c-788a-4936-8b7c-2b73fc142250 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.792310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b253856-413e-48fd-8264-c841cc82ac32 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.815254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.816059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.816341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.817195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.824309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.825749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.828582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa661118-c9a6-4e91-98b7-5c99273ce619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.829226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa661118-c9a6-4e91-98b7-5c99273ce619 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.829513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa661118-c9a6-4e91-98b7-5c99273ce619 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.829791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa661118-c9a6-4e91-98b7-5c99273ce619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:24.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:24.843799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:24.844783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 331/656] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:24.845808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:24.881004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.903437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa661118-c9a6-4e91-98b7-5c99273ce619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:24.904897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa661118-c9a6-4e91-98b7-5c99273ce619 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:24.910961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:24.958669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b48468-9511-4f65-a1f7-a70d4be99a83 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:24.995741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:24.996754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:24.997264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:24.997763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:24.998808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:24.999251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.000881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.024228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 326/657] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:25.024425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 332/658] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jun 29 11:05:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:25.024425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.026086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18dde-ee0d-4c54-8222-2c74ff88a391 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.026086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18dde-ee0d-4c54-8222-2c74ff88a391 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.026086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e18dde-ee0d-4c54-8222-2c74ff88a391 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.026086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 327/659] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:25.029101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18dde-ee0d-4c54-8222-2c74ff88a391 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.115538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.135114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057d485-a7cd-4305-93d8-8b8aedfb520f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.138338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e18dde-ee0d-4c54-8222-2c74ff88a391 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.149343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.172468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.173211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.173594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.173905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.174797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:25.175216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.175392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.176628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.176969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.177308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.177763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8dfc8-6709-41f1-83e8-5a996ac2c636 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.196554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 333/660] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:25.197755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.198042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.198319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.214342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:25.215546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:25.250306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.251855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.291421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 334/661] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:25.292450 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.350727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.377520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 328/662] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:25.377520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.410914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.414461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aea8ab-8c68-4015-9934-696a71f56736 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.453770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.454681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.455062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.455423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.466579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.468259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.482520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb37f16-1cd6-4883-a4d7-0822e3c2984a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:25.487582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:25.489300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:25.490396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:25.490396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:25.490396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:25.490396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:25.495625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 335/663] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:25.495625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.529596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.530255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.530541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.530821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.583797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.603710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced640eb-bbd6-4c48-ab96-816c9673debc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.605404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.606839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.638732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.639579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.639867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.640147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.650818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:25.658584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:25.659768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 336/664] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:25.668169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.688686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.722691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 329/665] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:25.722691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.798081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2eb17-8527-47fe-a0dc-0c5c0be25c55 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.817348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.832568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.833346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.833631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.833960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.842451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88784039-cfe7-41b5-ba0c-310f6c66ee5c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:25.845199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.846650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:25.865003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:25.865926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:25.866834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:25.866834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:25.866834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:25.866834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:25.866834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 337/666] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:25.867685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.888214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb598616-edce-403b-8801-1495be206905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:25.888876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb598616-edce-403b-8801-1495be206905 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:25.889160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb598616-edce-403b-8801-1495be206905 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:25.889437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb598616-edce-403b-8801-1495be206905 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:25.890161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb598616-edce-403b-8801-1495be206905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:25.890468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb598616-edce-403b-8801-1495be206905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:25.891917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb598616-edce-403b-8801-1495be206905 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:25.908632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 330/667] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:25.908632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb598616-edce-403b-8801-1495be206905 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:25.934507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:25.978083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffebb2a-b937-4cd8-8e5d-62acba66e1aa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.015158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb598616-edce-403b-8801-1495be206905 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.019547 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.020720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.021006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.021288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.022038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.022348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.023749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.032107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 338/668] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.032898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.060879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.062018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.062358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.062646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.073455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.076171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.078073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:26.097730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:26.099245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:26.100146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:26.100146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:26.100146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:26.100146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:26.100146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 331/669] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:26.100449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.144323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e10ffb-ef76-4371-83de-46485c40523d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.172492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.183503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.184201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.184788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.185072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.185797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.186104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.187489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.200377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 339/670] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.201444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.209512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771acee-617f-4a45-b18e-f38bd9c414bd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.244433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.245217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.245510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.245813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.253195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.255311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:26.271229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:26.272137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 332/671] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:26.273394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.311437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058982e7-35a6-40b0-9270-221dc8d15743 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.331357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.351234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.351949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.352229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.352507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.362405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.364138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:26.382225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:26.383298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:26.384386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:26.384386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:26.384386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:26.384386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:26.387080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60b99a-89c6-46d9-bf4d-3af96803bf6a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.387897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 340/672] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:26.388783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.425152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.426140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.426582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.427001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.428207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.429016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.429501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.431293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.443545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 333/673] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.444366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.493329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1da49d-d95a-4d97-a16a-83d72aec64f9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.527262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.528051 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.528341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.528624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.535236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.536680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.542661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389017e3-4fcf-43ed-a194-2b3f670392c4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:26.550256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:26.551330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 341/674] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:26.552395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.557333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.578928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.579617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.579902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.580184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.580951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.581259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.583300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e47ab-2f4c-4485-891b-7be8489853bc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.595062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 334/675] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.599941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9152b-9771-4994-8798-e77b2f1b942d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.599941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9152b-9771-4994-8798-e77b2f1b942d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.599941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9152b-9771-4994-8798-e77b2f1b942d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.599941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 335/676] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:26.599941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9152b-9771-4994-8798-e77b2f1b942d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.648950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.652868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc43e3-0f7b-44fa-94b3-ebdb6b28e63d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.686059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.686713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.686997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.687308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.688018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.688324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.689683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.700078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9152b-9771-4994-8798-e77b2f1b942d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.701730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 342/677] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.702562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.733401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.734187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.734470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.734744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.741832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.743291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:26.757483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:26.758548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 336/678] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:26.764152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.791702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.809313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f7be-aca5-4655-81f1-0fc4f18c4646 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.843641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.844295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.844579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.844856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.845637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.845949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.847404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d5a0f-7d19-4581-a911-195895168a3e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.858648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 343/679] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.859815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.860105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.860383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1816f-58d7-489b-a91f-d72c66a288c1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:26.860483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.876986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:26.878148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:26.891408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:26.895292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:26.895951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:26.896235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:26.896520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:26.897344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=14b23668139e429bacd32a5d4fc0994e) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:26.897657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:26.899200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:26.914063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 337/680] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/role_assignments?user.id=14b23668139e429bacd32a5d4fc0994e&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:26.914063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:26.950834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 344/681] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:26.960853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.028472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.035087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13424efa-0afe-4313-8dda-574cf6b8abef None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.074853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.075688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.075972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.076241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.084891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.085801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.086372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d34f4-b4bb-4af3-acd0-15980569a385 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:27.102830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:27.103916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 338/682] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:27.104872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.131024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.131880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.132287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.132576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.133534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:27.133838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.135657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.148508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 345/683] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:27.149810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.166627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.216161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf5544-149b-483f-8e8e-21733258aa74 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.252743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.253399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.253683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.253961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.254811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=adcb515e83b3484f9e93e18497fbbdfd) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:27.255098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd6262-9acc-4679-acf9-93b45f97c0f9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.255204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.256672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.268890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 339/684] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/role_assignments?user.id=adcb515e83b3484f9e93e18497fbbdfd&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:27.268890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.302247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.304698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.306036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.307104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.308363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.325706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.327576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:27.349585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:27.350792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:27.351943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:27.351943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:27.351943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:27.351943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:27.353667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 346/685] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:27.354412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.407196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec19845-2f03-4f3b-b3dc-198b18511f6e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.422585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.447424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.448113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.448608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.448710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.449635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:27.449952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.451421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.471291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 340/686] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:27.472145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.479431 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65b56d-75f8-41ed-abb8-b76a8b398d60 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.532310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.532971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.533774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.534057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.535194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=f69233ef76fb44b78ac88a111c883182) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:27.536070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.538477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.546920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 347/687] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/role_assignments?user.id=f69233ef76fb44b78ac88a111c883182&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:27.547993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.577146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.641057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa096ecf-4e4b-4183-b2d2-5c215975afcc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.679546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d03b38-1f95-4269-bd8c-a83a015dc0fb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.712293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.727544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.728210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.728497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.728774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.747859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.748536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.748824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.749100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.749825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:27.750132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.751702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.772035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 341/688] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:27.777745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.819400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.821240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.898230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968016b8-0f45-4e86-b568-ff443406adb1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:27.935916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 348/689] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:27.936621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:27.937396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:27.937686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:27.937959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:27.938659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:27.943069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:27.944179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:27.949661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:27.970328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 342/690] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:05:27 2022] POST /identity/v3/users => generated 254 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:05:28.012254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:28.138430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bf0f9-92ec-45c5-9f33-7fa718a7ec08 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:28.179057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:28.179851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:28.180136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:28.180408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:28.192467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:28.193863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:28.212362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:28.213318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:28.214203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:28.214203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:28.214203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:28.214203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:28.218065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 349/691] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:28.219466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:28.331304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151dfdb8-4fdc-46be-a526-65942f6ddf47 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:28.378477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:28.379797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:28.380087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:28.380360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:28.381090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:28.381397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:28.382833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:28.398349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 343/692] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:28.401249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:28.488068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:28.508376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02878ecd-ffd1-4ccf-b7ab-a4d52837ea1b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:28.543149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:28.543943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:28.544227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:28.544507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:28.552265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:28.553970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:28.568663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:28.569648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:28.570571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:28.574486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 350/693] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:28.575867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:28.652719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:28.705709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c77fb-ea72-4eb9-a0c2-f17d129e5663 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:28.755656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:28.756303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:28.756593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:28.756869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:28.757661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:28.757968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:28.759417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdb4ac-c80f-4e22-8465-dbf80844e346 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:28.778252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 344/694] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:28.784103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:28.892448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513e314-6a65-42b3-89aa-f2a2fe0a11fd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:28.929060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:28.929714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:28.929996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:28.930268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:28.931121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=45862644baba4528bd6dbe4dab092089) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:28.931435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:28.932994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f290a-e5b2-4ee4-82d3-b00537d81135 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:28.936206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:28.947197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 351/695] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:28 2022] GET /identity/v3/role_assignments?user.id=45862644baba4528bd6dbe4dab092089&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:29.474175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23273d00-6ba9-48c7-86ca-e28486da6332 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:29.474722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23273d00-6ba9-48c7-86ca-e28486da6332 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:29.474722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23273d00-6ba9-48c7-86ca-e28486da6332 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:29.476430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 345/696] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:29.481931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:29.482227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:29.482505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:29.500537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:29.501711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:29.571945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 352/697] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 11:05:29.597372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23273d00-6ba9-48c7-86ca-e28486da6332 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:29.729831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23273d00-6ba9-48c7-86ca-e28486da6332 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:29.748524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:29.781643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844774ba-62fb-4f0f-8db9-167db0dffbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:29.782454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844774ba-62fb-4f0f-8db9-167db0dffbdc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:29.782745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844774ba-62fb-4f0f-8db9-167db0dffbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:29.783100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844774ba-62fb-4f0f-8db9-167db0dffbdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:29.803892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844774ba-62fb-4f0f-8db9-167db0dffbdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-844774ba-62fb-4f0f-8db9-167db0dffbdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:29.811610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:29.812524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:29.813357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 346/698] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:29.820311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.029064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc2ccc-8b22-4577-a4b3-888653a5a7ce None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:30.113207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:30.123442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:30.124185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.124479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.124866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.125549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:30.125870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:30.130141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:30.141795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deca4b-3118-4c39-9b63-bed8bf1fd7e7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.142107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deca4b-3118-4c39-9b63-bed8bf1fd7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.142378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41deca4b-3118-4c39-9b63-bed8bf1fd7e7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.143410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 353/699] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:30.148167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 347/700] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:30.149341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.156472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c8c4-d80f-4bbb-9d9a-4e47a1484136 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.156869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c8c4-d80f-4bbb-9d9a-4e47a1484136 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.157202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136c8c4-d80f-4bbb-9d9a-4e47a1484136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.203605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f136c8c4-d80f-4bbb-9d9a-4e47a1484136 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:30.204827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f136c8c4-d80f-4bbb-9d9a-4e47a1484136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:30.345719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078546d-e741-40d6-b232-e3c412b01829 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:30.378323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 348/701] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:30.380603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de723f8-b167-4a27-8334-69b28f5f750d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.381097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de723f8-b167-4a27-8334-69b28f5f750d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.381920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de723f8-b167-4a27-8334-69b28f5f750d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.383666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 349/702] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:30.391420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.391420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.391420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.416266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:30.417088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.417377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.417660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.437001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:30.438952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:30.444800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:30.446273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:30.478779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:30.479762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:30.480656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:30.480656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:30.480656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:30.480656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.489668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 354/703] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:30.490516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.559411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:30.602685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 350/704] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:30.608562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.641935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599808d-bc37-44f6-a671-683f3f997f0a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:30.660269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:30.692740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:30.693874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.694274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.694662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.695640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:30.697619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:30.718497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:30.719795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:30.720850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.726464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 355/705] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jun 29 11:05:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:30.727722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.738380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1177883-c43d-4b77-8946-8e58cc105bcd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:30.774918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:30.775625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.775916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.776196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.776914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:30.777225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:30.778585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f3255-7f2a-46eb-bc36-73b47f278768 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:30.790446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 351/706] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:30.791716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8faef-169a-4a17-9922-517976df6a77 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.792008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8faef-169a-4a17-9922-517976df6a77 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.792292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8faef-169a-4a17-9922-517976df6a77 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.793679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 352/707] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:30.796336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8faef-169a-4a17-9922-517976df6a77 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.851857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a59f8-0e87-4d67-90ed-1c0582a58f55 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:30.861004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:30.893611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:30.894985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.895424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.895815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] PATH_INFO: `/v3/services/network` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.896771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:30.898856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:30.899115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:30.908734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8faef-169a-4a17-9922-517976df6a77 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:30.914318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:30.920230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:30.921331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 356/708] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:30 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:30.922282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:30.957705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:30.958389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.958676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.959382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.960119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:30.960434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:30.962175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02804599-0b8f-4ac0-ad9d-450fac610499 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:30.973284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 353/709] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jun 29 11:05:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:30.973284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:30.973284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:30.973284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:30.992841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:30.994044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:31.025546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec40ec0-9a62-46b1-9cfd-4b525bdae8bf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.065771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 354/710] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:31.066947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.075921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.076722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.077010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.077290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.087288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.088767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:31.104112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:31.105057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 357/711] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:05:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:31.106042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.142656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:31.163724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:31.179586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164ccb7-c302-4a01-869b-a9537d71d639 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.218139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.218810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.219121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.219405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.220119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:31.220416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.221775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.222516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a78c3-cb65-4046-ad28-06102bdbc969 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.231124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 355/712] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:31.231124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.258445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.259146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.259434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.259711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.260416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:31.260724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.262097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.268336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 358/713] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:31.271988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.358282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f662a-7407-4e67-a07a-f4862bf3fef6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.392200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:31.401178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11056d30-92a0-48d3-80e3-e01d238d876c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.411229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.412061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.412357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.412639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.429229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:31.438252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:31.439396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 356/714] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:31.445880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.448825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.449365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.449651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.449928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.450768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:31.451112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.452671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.459823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:31.477176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 359/715] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:31.478055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.563677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46efe67d-f9e4-45a3-a7fa-0b57192afa8b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.600941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.601616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.601900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.602175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.602885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] RBAC: Adding query filter params (type=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:31.603452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.604597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.611080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c102f1-4d8e-4853-af12-de3535907891 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.611534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 357/716] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:31.611940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.704435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.705100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.705386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.705666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.706465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:31.706779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.708941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.728332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 360/717] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:31.734206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:31.739991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:31.780257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb586d-42ea-47f4-8e02-078b303f16ab None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.784147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:31.837113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebc5e6-867c-4855-910d-88b81038bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.837809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc5e6-867c-4855-910d-88b81038bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.838099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc5e6-867c-4855-910d-88b81038bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.838381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebc5e6-867c-4855-910d-88b81038bfb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.891224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947b97a-7fbf-4445-9a1f-13467b503e0b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:31.927935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:31.928741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.928850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebc5e6-867c-4855-910d-88b81038bfb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.929018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.929297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.930511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebc5e6-867c-4855-910d-88b81038bfb2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.942481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:31.943984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a99ca4ae-6a24-4339-97e7-c57f3a707f33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:31.961424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:31.962521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:31.963845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:31.963845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:31.963845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:31.963845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:31.963845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 361/718] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:31.968779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a1854-ed85-4265-81c4-cebdaa75062f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:31.969076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a1854-ed85-4265-81c4-cebdaa75062f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:31.969366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a1854-ed85-4265-81c4-cebdaa75062f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:31.970905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 362/719] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:31.971902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a1854-ed85-4265-81c4-cebdaa75062f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.027350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.063328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.072276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 358/720] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:32.074423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.074936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.075545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.093843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:32.095437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:32.100664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a1854-ed85-4265-81c4-cebdaa75062f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.139573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.140255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.140543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.140826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.141556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:32.141868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.143386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.160385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 363/721] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:32.160385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.178806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 359/722] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:32.179769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.289267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0218d8-35e2-4c7e-9c79-439d24877bd4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.305816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05029fce-aadc-4da8-bc1e-9ba49c63d0bd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.315280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.323659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.334980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.336347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.337034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.337830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.352750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.353578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.353868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.353975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.354204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.355464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.362135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.364219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:32.373616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:32.374495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:32.375410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:32.375410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:32.375410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:32.375410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:32.379308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 364/723] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:32.379872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:32.381411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:32.383668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:32.384905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.385144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 360/724] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:32.385144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.496112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a0dc-6143-4767-8afa-71887455729a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.496891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb80c-8b59-4b5d-a5b7-51c59bf9622f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.531620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.532471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.532758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.533034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.533297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.534148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.534439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.534721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.536011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:32.536324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.537717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.544406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:32.550185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 361/725] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:32.551600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:32.557110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:32.559231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 365/726] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:32.561125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.581313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.605846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.662395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9809b7c-2cb4-4821-88e7-dc105dbb2f8e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.669813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec930-6bf9-47ac-b257-b6e127965139 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.699297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.700212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.700650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.701102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.702284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:32.702823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.704772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.705016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.705978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.706336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.706743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.714752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.716350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.726446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 362/727] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:32.732585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:32.733480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:32.734373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:32.734801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.740839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 366/728] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:32.741890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.825372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.844415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f4151-dc31-4f15-b949-74b7eeb1a882 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.850946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:32.857122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcfc49-635b-4f61-9a93-ad9028819554 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:32.882693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.883707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.884148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.884578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.885490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:32.885972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.887568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:32.896958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:32.897689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:32.898062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:32.898570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:32.899459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 363/729] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:32.900478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:32.972551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:32.974684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.019426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b058cc-42c5-4ccc-af07-d525327c7ca7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.058366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.059435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.059931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.060437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.061430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:33.061949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.063642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.077699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 364/730] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:33.078834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.088958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:33.091653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:33.097616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 367/731] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:33.098744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.200715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef4320-64a3-45c3-849e-33ad7752f367 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.205523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56724f78-f58e-47ce-a50e-8dfb4078d148 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.243181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.243880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.244163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.244491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.245324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=14b23668139e429bacd32a5d4fc0994e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:33.245641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.247188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.251862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.253566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.254949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.255553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.263245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 368/732] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/role_assignments?user.id=14b23668139e429bacd32a5d4fc0994e&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:33.264664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.269243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.272846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:33.296698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:33.297662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:33.298653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:33.298653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:33.298653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:33.298653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:33.301741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 365/733] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:33.311198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.408276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:33.439938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:33.502006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab360-dfd6-4c08-a05c-e6658630296b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.511583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b725154-02ba-4fe6-93db-34699c6a996a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.540847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.541326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.541613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.541888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.553959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.555255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.569870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.570557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.570846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.571148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.571888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:33.572200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.573584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:33.592536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:33.593460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:33.594340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:33.594340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:33.594340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:33.594340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:33.594340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 369/734] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:33.600958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.606264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 366/735] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:33.611756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.764320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7beacb5-c464-4f21-9a67-2c6478bc8e00 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.781665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:33.790148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22f344-683e-45a6-b00d-2a5eeba63ec5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:33.818308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.820618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.821109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.821792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.823641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:33.824915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.826506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.830426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:33.850295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 370/736] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:33.857267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.863127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:33.867087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.867087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.867087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.873582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:33.875011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-aa60e427-2f5f-4238-831a-e41133f423f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:33.891120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:33.892588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 367/737] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:33.894078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1ba0-3727-42bf-9ef3-5729129349bc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:33.895191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1ba0-3727-42bf-9ef3-5729129349bc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:33.895191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1ba0-3727-42bf-9ef3-5729129349bc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:33.901137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 368/738] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:33.902066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1ba0-3727-42bf-9ef3-5729129349bc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:33.972394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586c18e-5464-4635-9b28-7c5d73133fdd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.019351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.020114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.020399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.020681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.027535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.029018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.034482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e1ba0-3727-42bf-9ef3-5729129349bc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b37fba2c-259d-44ef-865c-854b236ebc3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:34.043161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:34.044067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:34.045013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 371/739] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:34.045513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091062a-b618-4542-aea2-d32000ede23b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.046045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091062a-b618-4542-aea2-d32000ede23b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.046045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091062a-b618-4542-aea2-d32000ede23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.067019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d091062a-b618-4542-aea2-d32000ede23b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:34.068558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d091062a-b618-4542-aea2-d32000ede23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:34.075535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.076306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.076591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.076871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.077696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:34.078004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.079458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd071-ece1-4158-91a0-4b8d0ee3f426 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.096957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 369/740] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jun 29 11:05:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:34.098925 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47742-8033-429b-9ac0-37e7b0d95ce7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.099241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47742-8033-429b-9ac0-37e7b0d95ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.099520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd47742-8033-429b-9ac0-37e7b0d95ce7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.103072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 370/741] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:34.103072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd47742-8033-429b-9ac0-37e7b0d95ce7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:34.106986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.144101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.149006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 372/742] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:34.159928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091062a-b618-4542-aea2-d32000ede23b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:34.220766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd47742-8033-429b-9ac0-37e7b0d95ce7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.257617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.258327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.258557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.258835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.259640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:34.259952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.261362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216a899-f700-4107-bf3d-b516d9875ea5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.274124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 371/743] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:34.275675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.275971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.276254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.281276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091062a-b618-4542-aea2-d32000ede23b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.292978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:34.294281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:34.321786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.322444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.322733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.323017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.361036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.364838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 372/744] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 11:05:34.365675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:34.392562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.406582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.408083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.474256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218e0c0-f7d4-49f7-ae1a-d2be2330913c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.510253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.511193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.511643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.512078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.512938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.514302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.521692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 373/745] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 11:05:34.521692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:34.543152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 373/746] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:05:34 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:34.543152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:34.604736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.641745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.646811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61e1c-3851-469b-ac8e-46e396d472ad None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.675790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e6391-9818-4306-b1ce-366a40233108 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.695549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.696518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.696961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.697393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.699095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=843ec60c1cce46738de1afa2accae5fc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:34.699668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.701728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.715324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 374/747] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:34 2022] GET /identity/v3/role_assignments?user.id=843ec60c1cce46738de1afa2accae5fc&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:34.715324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:34.752558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.753247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.753659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.754483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.755461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.757722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.781546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 374/748] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:05:34 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:34.863071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6c8fb-5e8a-42e1-8f4d-ba37c31d68ca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:34.904161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:34.916838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:34.918060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:34.918563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:34.919120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:34.932944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:34.934863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:34.955900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:34.956864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:34.957790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:34.957790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:34.957790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:34.957790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:34.961727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 375/749] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:34.965352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:35.085278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5da5e-a3d0-4cca-9040-ed4c4ffc3f3e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:35.123498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:35.124095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:35.124385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:35.124774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:35.125399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:35.125710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:35.127123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:35.141018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 375/750] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:35.146453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:35.256482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314c7b5-d55c-483a-be22-c10087f72dad None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:35.295737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:35.296849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:35.297339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:35.297795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:35.306093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:35.307846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:35.325522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:35.326451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:35.327386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 376/751] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:35.334398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:35.337199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:35.460664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982daebd-9ebc-4c7e-81d0-6cac05905326 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:35.497189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:35.497864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:35.498154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:35.498437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:35.499275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:35.499594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:35.501033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103ad5-89af-4bc4-8b49-eb3ac326af08 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:35.513876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 376/752] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:35.519764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:35.574011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:35.644325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa4c53-a222-4525-a5e5-48bb338b9329 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:35.691797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:35.692475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:35.692761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:35.693044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:35.693890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=45862644baba4528bd6dbe4dab092089) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:35.694208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:35.695681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ffc3c-30fb-43dd-8c02-b085c1442c82 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:35.701986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 377/753] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:35 2022] GET /identity/v3/role_assignments?user.id=45862644baba4528bd6dbe4dab092089&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:36.048034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf930-495c-4868-820b-b4444058587e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:36.049020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf930-495c-4868-820b-b4444058587e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:36.049510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cf930-495c-4868-820b-b4444058587e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:36.051401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 377/754] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:36.056727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:36.057564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:36.058072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:36.080551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:36.082086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:36.164736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 378/755] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:36.216518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf930-495c-4868-820b-b4444058587e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:36.294916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:36.352696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cf930-495c-4868-820b-b4444058587e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:36.398538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:36.399751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:36.400248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:36.400767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:36.414760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:36.423210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:36.424207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:36.425057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:36.429784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 378/756] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:36.437176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:36.490756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:36.593002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b145e4-14e5-4d2a-8ecd-9b00ae569e52 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:36.639513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:36.640180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:36.640466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:36.640743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:36.641493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:36.641799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:36.643192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:36.654615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 379/757] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:36.660765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:36.808369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55077b65-00c9-473a-991b-ef483814f60b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:36.840431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:36.860710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:36.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:36.861739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:36.862020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:36.873488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:36.874955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:36.897226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:36.898156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:36.899033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:36.899033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:36.899033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:36.899033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:36.899033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 379/758] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:36.907009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.033258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b6a1-af54-4ef2-a61c-62bf3010e9c7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:37.039060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:37.078097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:37.079475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.079912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.080339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.081242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:37.081702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:37.083297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbc151-59a3-47ac-bf07-9b5ca9cef850 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:37.100652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 380/759] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:37.106490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.167327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98d402-fb73-4807-800d-7f5c9d2d2473 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.168087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98d402-fb73-4807-800d-7f5c9d2d2473 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.169455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98d402-fb73-4807-800d-7f5c9d2d2473 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.170994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 381/760] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:37.188464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.189147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.190192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.234584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:37.236585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:37.278250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3d8e3-9747-4a77-9b8b-ae43fe706e84 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:37.337106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:37.338247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.338703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.339167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.357280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:37.359102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:37.375212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:37.376229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:37.377177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:37.380070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 380/761] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:05:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:37.396575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.458893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:37.487997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 382/762] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:37.531397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.554167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d51e11b-f157-4a0b-b6ea-5817878ca7ab None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:37.600590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:37.601265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.601553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.601833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.602694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:37.603010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:37.604474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1b73-0714-493e-80c0-ff76c4029443 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:37.633481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 381/763] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:05:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:37.633481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56377cbd-d3b1-4db8-9691-774144e0299e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.633481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56377cbd-d3b1-4db8-9691-774144e0299e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.633481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56377cbd-d3b1-4db8-9691-774144e0299e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.633481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 382/764] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:37.633481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1391f-1c63-450b-8407-24d3ef36eb6f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.634005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1391f-1c63-450b-8407-24d3ef36eb6f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.634005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1391f-1c63-450b-8407-24d3ef36eb6f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.635393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 383/765] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:37.639683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1391f-1c63-450b-8407-24d3ef36eb6f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.640433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:37.658964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65293b-3151-49d9-8ea9-fa7a4a99589a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:37.699253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:37.700475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.700886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.701305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.702189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:37.703924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5b85881e-ecaa-43d5-af2d-a432811ee31a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:37.719478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:37.720616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:37.721538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:37.724145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 383/766] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jun 29 11:05:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:37.725580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85874-f7dd-49c9-acaf-a167c2bc1f45 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.725863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85874-f7dd-49c9-acaf-a167c2bc1f45 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.726139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf85874-f7dd-49c9-acaf-a167c2bc1f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.742757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:37.743598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0cf85874-f7dd-49c9-acaf-a167c2bc1f45 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:37.744866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0cf85874-f7dd-49c9-acaf-a167c2bc1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:37.755494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1391f-1c63-450b-8407-24d3ef36eb6f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:37.800237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:37.801074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.801360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.801645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.813046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:37.814500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:37.831067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 384/767] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:37.831067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:37.831067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:37.831067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:37.843594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:37.844700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:37.845876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:37.845876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:37.845876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:37.845876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:37.849828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:37.851029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:37.851449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 384/768] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:37.852308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.921540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 385/769] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:37.922492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:37.945897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:37.966047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b45a64-a38e-40bf-b789-60689a792c02 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.010373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.011355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.011920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.012349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.013652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.014424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.016119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.022061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 385/770] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jun 29 11:05:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.022976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.039432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.047020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bea45-c032-4cf5-8045-21a23392a7d5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.083377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.084182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.084468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.084747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.095050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:38.102672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:38.103613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:38.104441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:38.108849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 386/771] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:38.109487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.140835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5d769-d61d-4678-ad46-0fd403f85b4a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.179429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.180109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.180399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.180516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.180685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.181410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.181761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.183116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.195548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 386/772] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.196202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.223429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea6aed-a5a3-47d5-872a-af8d0dead4bd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.260577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.261207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.261534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.261813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] PATH_INFO: `/v3/services/network` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.262409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.263802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.265896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:38.276204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:38.277360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:38.278199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 387/773] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:38.278994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.308407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7061b5-9a0e-4102-bf9d-53c4cc931930 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.341561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.342261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.342552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.342835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.343566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.343876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.345241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.350550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 387/774] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.351329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.378398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea631b-402e-4c54-b0d2-6162a3325039 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.406961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.412569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.413244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.413722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.414079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.414837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.415185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.416558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.424649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 388/775] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.425419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.457003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa104e-958a-4f47-9e36-0f0f58d08e91 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.485459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.491101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.491903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.492191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.492474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.499263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.500710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-deb52059-c92e-4f45-9abc-f6b0010bf7bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:38.514884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:38.515796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:38.516712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 388/776] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:38.517196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1372fce-c5f1-49d7-8a41-830cec08fab0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.517479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1372fce-c5f1-49d7-8a41-830cec08fab0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.517772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1372fce-c5f1-49d7-8a41-830cec08fab0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.518994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 389/777] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:38.519730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1372fce-c5f1-49d7-8a41-830cec08fab0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.527565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17bb6c-aba7-44e5-9c52-60d823dc02ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.562633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.563330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.563621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.563900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.564601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] RBAC: Adding query filter params (name=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.564911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.566273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.570989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 389/778] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.571626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.622689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1372fce-c5f1-49d7-8a41-830cec08fab0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.631308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.656122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.656781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.657068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.657351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.658134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] RBAC: Adding query filter params (interface=public, service_id=635cbd06fe7a40a4802e9589519be187, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.658450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.659860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.667755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 390/779] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/endpoints?service_id=635cbd06fe7a40a4802e9589519be187&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.668525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.672148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10b4eb-d078-4ee2-9b39-0c4e1e0ce2fd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.704508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.705296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.705581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.705916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.717295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.718724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.725495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-18fe4177-fd43-4eda-b513-9c7df75ac087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:38.736705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:38.737591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:38.738506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:38.738506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:38.738506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:38.738506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:38.738506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 390/780] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:38.739137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.739420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.739703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.755373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:38.756543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:38.774501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4717b-4e05-4d65-bbb5-8da2f22727bd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.808404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.809072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.809357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.809637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.810419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.810731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.812215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.821706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 391/781] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:38.822501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.828827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 391/782] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.828827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.869784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.925440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02a05b-7266-443b-b875-3f65a2f22537 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.926843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b6ca-f607-4fa0-838b-2804976f05f0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:38.941971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:38.960163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.960354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:38.960827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.960993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:38.961116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.961282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:38.961399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.961562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:38.962083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.962263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] RBAC: Adding query filter params (type=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:38.962573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:38.963477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.963951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:38.968515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 392/783] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/services => generated 772 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.974064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 392/784] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:38.974238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:38.974346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.092674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89afb8f-245d-4bac-a661-7f6ce23f73ec None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.094052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e61e0-de4f-450d-9484-ed70aa94cbe7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.095370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.134684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.135609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.135895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.136179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/14b23668139e429bacd32a5d4fc0994e/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.137017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.137693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.137984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.138123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=14b23668139e429bacd32a5d4fc0994e, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.138270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.138996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:39.139355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.139630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.140706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.153825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 393/785] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:38 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/14b23668139e429bacd32a5d4fc0994e/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:05:39.154371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 393/786] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:39.154989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.155323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.227459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.288383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299c198-ca23-48e2-a717-b7bb207d2b98 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.299794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f792560-2648-4031-aeea-f5eb05ca4a79 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.341758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.342443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.342793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.343028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.343861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] RBAC: Adding query filter params (interface=public, service_id=071cb4dcab1844bbae6422c4c461707b, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:39.344183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.345587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.346130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.347134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.347560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.348030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.352220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 394/787] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/endpoints?service_id=071cb4dcab1844bbae6422c4c461707b&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:39.353103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.360076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:39.368520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:39.369624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:39.370665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:39.373007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 394/788] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:39.373917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.410033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.480769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f43c2-72d0-478d-8f7e-e41b39a3fc8d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.483310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.514210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0feb484-f893-4da2-9068-05f069e90626 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.518951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.520058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.520497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.520922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.528859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.530496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:39.552178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:39.553657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:39.554770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:39.555531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 395/789] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:39.556585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edace563-6277-4381-9552-b27e7db3349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.556708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.557563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edace563-6277-4381-9552-b27e7db3349b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.558023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edace563-6277-4381-9552-b27e7db3349b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.558483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edace563-6277-4381-9552-b27e7db3349b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.559501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edace563-6277-4381-9552-b27e7db3349b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.561263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edace563-6277-4381-9552-b27e7db3349b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.568116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 395/790] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:39.569278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edace563-6277-4381-9552-b27e7db3349b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.670933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.686765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edace563-6277-4381-9552-b27e7db3349b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.703587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523f0ce-6161-4f20-bc7c-b32ad1f7e59c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.726884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.728015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.728546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.729022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.730069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:39.730630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.732293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.762168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.763334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.763844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.764343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.766449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:39.767319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.769570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 396/791] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:39.771408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.780164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.782447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 396/792] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:39.788284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:39.834110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.911550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f85fd-3a34-45c3-91f0-846222e67a37 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.912065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13a1a3-0c4d-4a6e-8aa1-915643c47463 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:39.949826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.950220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.950509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.950789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.956906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:39.958085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:39.958590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:39.959107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:39.961814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.963300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.972455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:39.974786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:39.983354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:39.983515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:39.984342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:39.985682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:39.985682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:39.985682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:39.985682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:39.985682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 397/793] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:39.991589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:40.001297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:40.002204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:40.003155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:40.003155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:40.003155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:40.003155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:40.005527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 397/794] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:40.015640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.074731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:40.097753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb44f6-2388-414f-94af-4d0584fbabeb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.134752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.135484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.136042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.136519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.137288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:40.137703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.139213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.152157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 398/795] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:40.161890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.170490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bda571-4644-4d44-96a0-e9de95ef79dd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.274011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cacdeb-ab29-4608-814d-5113151161e7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.307426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.308284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.308577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.308798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.308915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.309568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:40.309673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.309882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.309982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.310169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.311491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.318196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.319682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.339403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:40.342213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 398/796] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:40.343789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:40.344929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:40.346558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 399/797] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:40.350392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.355859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.462036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7330b-fc0e-42ab-b3c0-1a8832a70c87 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.497490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.498196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.498616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.498907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.500121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:40.500693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.502905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.516858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:40.524521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 400/798] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:40.530016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.589774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:40.616525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3771de-0cd7-40c6-aec7-bf9039ce8299 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.647468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302cf7f-5d50-4aa9-9909-13ab6dc9d54b None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.682733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.683570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.683858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.684136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.693897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.694970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.695222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.695683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.696178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.696690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.713792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:40.715432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:40.716344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:40.717858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:40.717858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:40.717858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:40.717858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:40.717858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 401/799] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:40.718762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.722507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:40.743740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:40.744674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:40.745564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:40.748040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 399/800] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:40.755858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.834453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb24df2-8e85-4776-ae5e-3a0b51176fa3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:40.844032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:40.870223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:40.870896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:40.871265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:40.871555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:40.872277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:40.872587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:40.873958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:40.886729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 402/801] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:40.892170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:40.996313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12947272-7fde-4d4f-8649-d39d344badaf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:41.017214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086fb74-474d-48e9-b2c0-96de952ccbe5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:41.035868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:41.036671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.036961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.037242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.049502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:41.051524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:41.056653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:41.082560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:41.083545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:41.084963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 403/802] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:41.090042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:41.090733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.091089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.091374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.092210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:41.092530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:41.094101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:41.096886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:41.122490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 400/803] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:41.127863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:41.154076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:41.274642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219b91a-b287-4367-938b-f51f8ef77de9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:41.311658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:41.312385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.312674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.313007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.313798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:41.314111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:41.315584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:41.327766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 404/804] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:41.333438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:41.355637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300d490-b3b7-425c-9c22-4b87082a4e3d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:41.392036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bec38-9536-469e-8ae6-2f58d0ceff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:41.393267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bec38-9536-469e-8ae6-2f58d0ceff39 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.393850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bec38-9536-469e-8ae6-2f58d0ceff39 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.394325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bec38-9536-469e-8ae6-2f58d0ceff39 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/843ec60c1cce46738de1afa2accae5fc/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.409597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bec38-9536-469e-8ae6-2f58d0ceff39 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=843ec60c1cce46738de1afa2accae5fc, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:41.412684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bec38-9536-469e-8ae6-2f58d0ceff39 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:41.427901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 401/805] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:41 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/843ec60c1cce46738de1afa2accae5fc/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:05:41.429847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26787-57e4-4f7b-9eb2-9215d7332326 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.430337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26787-57e4-4f7b-9eb2-9215d7332326 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.430884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26787-57e4-4f7b-9eb2-9215d7332326 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.437120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 402/806] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:41.438134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:41.440737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.441334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.441977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.450638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf93c95-16da-4b1c-bd00-f706575e33dd None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:41.462445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:41.464092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:41.490374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:41.491729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.491729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.492013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/45862644baba4528bd6dbe4dab092089/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.495496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:41.495655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=45862644baba4528bd6dbe4dab092089, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:41.497225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:41.515894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 405/807] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:41 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/45862644baba4528bd6dbe4dab092089/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:05:41.563204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 403/808] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:41.581145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:41.708865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a9dc-ec52-462a-8d3c-4a7d7ee36e2e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:41.747447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:41.748268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.748556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.748836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.749486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:41.750861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a8222d16-3be6-4c4c-88d7-bc0665454f18 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:41.765627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:41.766694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:41.767965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 406/809] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jun 29 11:05:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:41.775556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:41.786281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee83f05-6be4-40fb-b9c2-167165be02c0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.788738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee83f05-6be4-40fb-b9c2-167165be02c0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.790439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee83f05-6be4-40fb-b9c2-167165be02c0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.798703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 407/810] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:41 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:41.801388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:41.802109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:41.803233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:41.836639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:41.838738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:41.856360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:41.927158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 408/811] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:41.948569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:41.964421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb51b34-0934-4b14-89c8-4ba4f8ae95df None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.012616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.013289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.013574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.013846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.014552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:42.014852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.016329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.022251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 404/812] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jun 29 11:05:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:42.029266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.075402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:42.152720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49194985-8bdc-4bee-a7cb-cfd61e0a352a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.215360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaebbf2-e991-455e-bb0a-0f71ac1edc53 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.225299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.226106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.226412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.226664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.244049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:42.255735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:42.256693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:42.257940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 409/813] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:42.264471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.270500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:42.284718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.285447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.285729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.286004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.286712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:42.287020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.291292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2906b-a146-4039-b62a-6d393cd62acb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.301270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 405/814] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jun 29 11:05:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:42.304884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92d06d-69dc-4ec2-8528-c07a5c390654 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.305641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92d06d-69dc-4ec2-8528-c07a5c390654 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.306517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92d06d-69dc-4ec2-8528-c07a5c390654 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.311902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 406/815] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:42.313351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92d06d-69dc-4ec2-8528-c07a5c390654 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.404323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432d2d1-7faf-43cf-ad0a-c24b040fac16 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.412736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:42.429654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92d06d-69dc-4ec2-8528-c07a5c390654 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.446393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.447527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.448137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.448611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:42.450099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.451837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa75cb-8579-4401-a441-338686a3e466 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.465454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.465454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.465685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.465919 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.466455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 410/816] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:42.466556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.467912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.468356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.468838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.469311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.489864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:42.492406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:42.503067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 407/817] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:05:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:42.503067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.617110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:42.642517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 411/818] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:42.655561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde93a7-9d47-45d0-a7c0-0bbd1557dbed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.692714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.730437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.731606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.732113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.732618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.745676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.747176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.748981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:42.770639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:42.771634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:42.772543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:42.772543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:42.772543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:42.772543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:42.776607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 408/819] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:42.778016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.909436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366c8a9-b569-4a05-9535-a4b49eddc546 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.940870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158919f-3d61-4f91-a671-3e39d2fc8be7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:42.948285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.949510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.949984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.950472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.951516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:42.952131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.953339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.966522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 409/820] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:42.972373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:42.981197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:42.983020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:42.983546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:42.984007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] PATH_INFO: `/v3/services/network` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:42.984863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:42.986428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:42.999547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:43.000651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 11:05:43.001487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:43.011323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 412/821] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:42 2022] GET /identity/v3/services/network => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:43.015943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:43.072589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:43.099432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:43.162379 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba4c4b-e05b-4276-8b5b-67aff52bab44 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:43.199002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:43.199843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.200158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.200671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.209760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a3127-fddf-48b5-9c51-746b83a6e016 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:43.212159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:43.215846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:43.230705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:43.231772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:05:43.232717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:43.239825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 410/822] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:05:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:43.246998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:43.250391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:43.251097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.251389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.251666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.252376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] RBAC: Adding query filter params (name=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:43.252685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:43.254494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:43.260589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 413/823] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:43.265860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:43.387420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b869d1-1ed0-44cc-b357-fd6604808637 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:43.411349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:43.427560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb18e6-2adb-432f-8d7d-eb3e3fcb262b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:43.442701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:43.446775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.447093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.447386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.448112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] RBAC: Adding query filter params (type=network) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:43.448427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:43.449807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:43.461380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 414/824] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:43.462537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:43.471598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:43.489291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:43.490266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.490761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.491257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.492286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:43.492791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:43.494426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:43.517292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 411/825] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:05:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:43.518791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:43.650222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212db553-c387-4592-9174-87eb34f7ff12 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:43.683219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf57590-e918-4d1b-b723-c2ba33d7bf9f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:43.716263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d58e04-198a-4866-ba5b-3cb78475afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:43.716930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58e04-198a-4866-ba5b-3cb78475afb5 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.717264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58e04-198a-4866-ba5b-3cb78475afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.717545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d58e04-198a-4866-ba5b-3cb78475afb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.718420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d58e04-198a-4866-ba5b-3cb78475afb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:43.719896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d58e04-198a-4866-ba5b-3cb78475afb5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:43.751270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5eb9d-1e17-4f3a-8de7-20e04cdea728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:43.753001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 415/826] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:05:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:43.753546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5eb9d-1e17-4f3a-8de7-20e04cdea728 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.754372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5eb9d-1e17-4f3a-8de7-20e04cdea728 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.754652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5eb9d-1e17-4f3a-8de7-20e04cdea728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.804470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:43.838393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5eb9d-1e17-4f3a-8de7-20e04cdea728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:43.840006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5eb9d-1e17-4f3a-8de7-20e04cdea728 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:43.914192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913a44c-38e3-4fce-9927-7e0002c53c95 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.914525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913a44c-38e3-4fce-9927-7e0002c53c95 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.914755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913a44c-38e3-4fce-9927-7e0002c53c95 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.917487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 416/827] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:43.923105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff21bd-1142-4fe9-ba4c-c701efa2182b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.923410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff21bd-1142-4fe9-ba4c-c701efa2182b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.923941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff21bd-1142-4fe9-ba4c-c701efa2182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.947246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-77ff21bd-1142-4fe9-ba4c-c701efa2182b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:43.949921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77ff21bd-1142-4fe9-ba4c-c701efa2182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:43.961930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 412/828] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:05:43.963387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1fc09-f30d-4344-bd0a-6685e7125b84 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:43.963675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1fc09-f30d-4344-bd0a-6685e7125b84 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:43.963954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1fc09-f30d-4344-bd0a-6685e7125b84 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:43.969343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 413/829] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:43.970159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1fc09-f30d-4344-bd0a-6685e7125b84 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.002172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.058952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 417/830] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:44.060112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.060410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.060680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.071923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.090454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:44.091669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:44.107082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1fc09-f30d-4344-bd0a-6685e7125b84 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.145873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.146667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.146952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.147257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.157665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.159133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.175345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 418/831] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:44.177031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:44.177378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:44.178541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:44.179494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:44.179494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:44.179494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:44.179494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:44.179494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 414/832] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:44.190383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.276541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.284544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167ec7-7142-45fe-86a4-4300934d28e4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.293570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47fbe8-74a2-4e4e-9b6d-3e4a8c3e952c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.320377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.321179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.321317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.321459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.321741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.333527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:44.334075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.334726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.335012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.335319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.336037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:44.336347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.337704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:44.341105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:44.342035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:44.342879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 419/833] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:44.343602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.350333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 415/834] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:44.351934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.451493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08528a4-c9b7-4b17-82b6-eb24c980a8fc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.453020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef475-fb4f-4437-b570-ad5b6d750203 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.489007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.489795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.490079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.490255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.490365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.491080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.491369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.491649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.492572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:44.493166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.494539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.501578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:44.507384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 416/835] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:44.507384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:44.511877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:44.512813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:44.513667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 420/836] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:44.520413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.535537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.562793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.621623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730882-e893-4dcc-8a72-07c5eefc93c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.625881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90efef-399e-44f9-b8df-a002e9a82954 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.659186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.660027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.660814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.661097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.662893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.663831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.664107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.664388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.667838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.669280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.675690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.677121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:44.683713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:44.684830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:44.685928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:44.691367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 417/837] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:44.691367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:44.697514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:44.698368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:44.699978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:44.699978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:44.699978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:44.699978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:44.703585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 421/838] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:44.704200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.772287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.803161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84850c4e-e246-4a51-bdc4-982c872649ce None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.809903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8f8b2-cdd3-4c60-bc75-625210e6549a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.811868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:44.840789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.841348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.841629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.841899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.842627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:44.842989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.844318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.845933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:44.846601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:44.846887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:44.847200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:44.848549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:44.848862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:44.850271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:44.853383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 418/839] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:44.854329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.864989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 422/840] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:44.866017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:44.965145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047719ec-5155-41c2-8ce2-632cf25918de None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:44.975231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e3fce-1b56-4895-b996-6c1d02f00208 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.004767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.005439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.005727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.006072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.006725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:45.007056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.007701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.008451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.017064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.018131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.018597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.019075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.021573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 419/841] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:45.022451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.035247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.036870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.050461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f186b448-f4b9-442d-be60-d8e0bead7588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:45.054464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:45.055464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:45.056357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:45.056357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:45.056357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:45.056357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:45.056357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 423/842] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:45.057033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc7833-81b7-41c9-97f1-4b0ecd177eab None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.057131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc7833-81b7-41c9-97f1-4b0ecd177eab None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.057345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc7833-81b7-41c9-97f1-4b0ecd177eab None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.059105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 424/843] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:45.059287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc7833-81b7-41c9-97f1-4b0ecd177eab None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.124989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9d7a5-1f27-4083-ac98-638269f2714e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.159084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.159741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.160033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.160315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.160835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc7833-81b7-41c9-97f1-4b0ecd177eab None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.161148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=14b23668139e429bacd32a5d4fc0994e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:45.161467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.162900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.168651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 420/844] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/role_assignments?user.id=14b23668139e429bacd32a5d4fc0994e&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:45.169418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.200448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.201291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.201586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.201863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.210971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.212474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9129f057-e8c7-47ff-99f3-affb3d7b0f17 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:45.229027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:45.230257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:45.231413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:45.235169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 425/845] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:45.237105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.237105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.237281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.254747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:45.256007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:45.284363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.290794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.296014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565b0c5-c4d0-4c15-9bb6-5fe21310ce13 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.337498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.337854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.338557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.338842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.339277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 426/846] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:45.340802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.340930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:45.340930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.342458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.356941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 421/847] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:45.361937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.459329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf89c7e-3de3-42fd-894e-976eb9ae602c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.472603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e69155-198a-4363-a115-af3bfe84bcaf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.497869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.498545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.498834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.499144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.499978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:45.500296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.501720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.509449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.510268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.510554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.510838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.511533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.512897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.520100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 427/848] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:45.523781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:45.525636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:45.526810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:45.527817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 422/849] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:45.528671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.548181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.563485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.641864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99184edf-22b6-435e-b3d4-4a8a77e04c0d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.643775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada522-37f3-4af7-8f26-22a6f6f3e2f0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.681143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.681143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.681143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.681143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.681551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.681551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.681551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.681551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.686839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.688303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:45.703322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:45.704344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:45.705491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 428/850] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:45.706086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.756149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.757648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.775105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.801204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:45.821569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107879d-68f5-4ade-8240-821a4273b91d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.854901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:45.855865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:45.856155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:45.856430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:45.857130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:45.857436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:45.858789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:45.863996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 429/851] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:45.864754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.867841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 423/852] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:05:45.869551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:45.979675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d8e55-cb93-49a4-9189-03cbbe8c887c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:45.981019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303d64e-9d97-4506-a314-7a6ab5ef04a0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.000735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.019761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.020606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.020903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.021223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.021954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:46.022269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.023672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.025177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.025851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.026138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.026410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.027270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:46.027589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.035678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 424/853] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:46.035935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.036029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.067316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 430/854] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jun 29 11:05:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:46.068644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.083716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.155735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f111122-bdee-41bd-895e-903d75a02a5b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.192940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873222d-5a9e-4078-8978-7b4b9a12273a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.193543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.194460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.194847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.195278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.208132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.210419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:46.229522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:46.230608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:46.231559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:46.231559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:46.231559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:46.231559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:46.231788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 425/855] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:46.238198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.244450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.245358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.245841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.246319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.273518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.322009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.323621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.334709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.351498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb1b94-8a28-4600-aaa3-bf9dc3f549e5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.392057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.392784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.393166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.393449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.394834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:46.395192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.396572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.409942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 426/856] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:46.416026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.455194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 431/857] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:05:46.456587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.526131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.537534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95e4af-9d14-4f5c-a240-34a896451310 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.571886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f68303-50ac-4925-bea3-1356beee11fc None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.580464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.582639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.583327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.583841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.584331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.594738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.596959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.610716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.611679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.612064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.612414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:46.616866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:46.617748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:46.618684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:46.625317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 427/858] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:46.625962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.628147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.630111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:46.650585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:46.651536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:46.652420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:46.652420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:46.652420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:46.652420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:46.656530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 432/859] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:46.657367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.758983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d627b-d47f-41db-8bb0-85689c630cd5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.773647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93609bfc-4d80-4fcc-80f3-f1edb52bbc35 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.796956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.797479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.797768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.798047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.799017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:46.799359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.801436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.818540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 428/860] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:46.819671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.824330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.825174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.825627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.826049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.826913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:46.827377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.828876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.835876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.844688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 433/861] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:46.852015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:46.879365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:46.943642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdc5f8-804b-4a96-9b13-dab8221f4323 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.967458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693942fd-fe87-4bca-ad99-26f1aa8f5290 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:46.979872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:46.980529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:46.980821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:46.981101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:46.981923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=843ec60c1cce46738de1afa2accae5fc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:46.982235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:46.983797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:46.995468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 429/862] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/role_assignments?user.id=843ec60c1cce46738de1afa2accae5fc&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:47.011467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:47.012739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.013231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.013721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.022688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:47.024601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:47.041633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:47.042585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:47.043513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:47.046238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 434/863] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:47.052595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:47.143193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:47.169285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cc097-1d00-46a7-b8d1-ad30bd8a45b7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:47.206267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:47.207539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.207832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.208115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.208907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:47.209222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:47.210662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db7efa-bb9d-4666-bb27-ac261767d75f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:47.223895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 430/864] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:47.229871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:47.298479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ad97-7ff4-40b8-9a60-d027753f4c29 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.298825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ad97-7ff4-40b8-9a60-d027753f4c29 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.299078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ad97-7ff4-40b8-9a60-d027753f4c29 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.300466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 431/865] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:47.306957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.307211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.307490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.329940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:47.331241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:47.333291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:47.352919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c369e-790d-4257-a331-eaa6da07cf96 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:47.395397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:47.396058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.396341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.396749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.397721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=45862644baba4528bd6dbe4dab092089) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:47.398097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:47.400026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:47.408034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 435/866] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:47 2022] GET /identity/v3/role_assignments?user.id=45862644baba4528bd6dbe4dab092089&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:47.411001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 432/867] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:47.433756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:47.545960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbcc47-514c-4a10-b1ec-dfe7c72edfcf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:47.581548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:47.583074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.583366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.583648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.584303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:47.585662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:47.598339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:47.600712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:47.602532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 436/868] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jun 29 11:05:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:47.607141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:47.683317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:47.720656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7b45-37b6-4251-83cd-f6b0d4ddfef5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:47.756948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:47.757862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.758544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.758997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.759873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:47.760330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:47.761840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a996961-85d7-44c0-8425-f963e508430e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:47.767085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 433/869] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:47.775150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:47.786780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:47.886478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964435ac-5e12-4dc2-8d8e-e81d6ec7f564 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:47.923720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:47.924396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:47.924685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:47.924969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:47.926218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:47.926532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:47.928190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897448e4-fbed-4732-be0a-4cc4d2733d63 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:47.933620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 437/870] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:48.193406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885edd22-3cd2-4b09-b582-8f4860dfa31b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:48.193753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885edd22-3cd2-4b09-b582-8f4860dfa31b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:48.193944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885edd22-3cd2-4b09-b582-8f4860dfa31b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:48.195506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 434/871] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:48.200726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058011b-6cac-475b-a02d-146956ffdb12 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:48.201027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058011b-6cac-475b-a02d-146956ffdb12 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:48.201309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058011b-6cac-475b-a02d-146956ffdb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:48.218928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f058011b-6cac-475b-a02d-146956ffdb12 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:48.220167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f058011b-6cac-475b-a02d-146956ffdb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:48.299331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 438/872] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:48.322943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885edd22-3cd2-4b09-b582-8f4860dfa31b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:48.428388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885edd22-3cd2-4b09-b582-8f4860dfa31b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:48.456706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:48.463311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259174a-0c0e-45b8-9ed6-f15d1534dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:48.463986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259174a-0c0e-45b8-9ed6-f15d1534dbed None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:48.464267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259174a-0c0e-45b8-9ed6-f15d1534dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:48.464610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259174a-0c0e-45b8-9ed6-f15d1534dbed None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:48.465337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259174a-0c0e-45b8-9ed6-f15d1534dbed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:48.466710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259174a-0c0e-45b8-9ed6-f15d1534dbed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:48.486739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 435/873] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:05:48 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:49.266183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be86b3-ae28-4f6b-a8af-8ad8eef86123 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.267231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be86b3-ae28-4f6b-a8af-8ad8eef86123 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.267731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be86b3-ae28-4f6b-a8af-8ad8eef86123 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.269598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 439/874] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:49.274849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.275677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.276180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.292978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:49.294417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:49.368217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 436/875] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:49.392244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be86b3-ae28-4f6b-a8af-8ad8eef86123 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:49.395527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:49.498446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be86b3-ae28-4f6b-a8af-8ad8eef86123 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:49.533354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce9299-58b5-479b-baec-4b26de67208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:49.534099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9299-58b5-479b-baec-4b26de67208e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.534391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9299-58b5-479b-baec-4b26de67208e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.534674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce9299-58b5-479b-baec-4b26de67208e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.545915 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce9299-58b5-479b-baec-4b26de67208e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-11ce9299-58b5-479b-baec-4b26de67208e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:49.555188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:49.556152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:49.556983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 440/876] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jun 29 11:05:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:49.562443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:49.606273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99d96-af83-4fb5-91b5-be50ffba2be0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.606598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99d96-af83-4fb5-91b5-be50ffba2be0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.606849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce99d96-af83-4fb5-91b5-be50ffba2be0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.608517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 441/877] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:49.616326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.616960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.617449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.635018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:49.636588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:49.671791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf1346-8b26-4a55-bf8d-cdcb84c50318 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:49.697977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:49.699557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:49.714439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:49.714944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 442/878] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:49.715699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.716133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.716561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.717457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:49.717928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:49.719940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:49.729958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 437/879] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:05:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:49.734845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:49.736411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:49.837481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb62b8-38a2-46d5-be3e-d3c6e343b584 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:49.842045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a21629-c6a5-4bd1-926c-f2655b3e6465 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:49.873979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:49.875207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.875573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.875944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.876675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:49.878107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:49.879901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:49.880989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:49.881473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:49.881940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:49.892082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:49.893090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:49.899362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 443/880] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:49.900181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:49.900181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:49.902808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:49.919913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:49.920831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:49.921755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:49.921755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:49.921755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:49.921755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:49.928779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 438/881] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:49.930424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:49.973977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:49.991442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:50.034082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec051c99-e0a1-4663-8a5e-78dce075ddc3 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.044891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dc19b-4ba4-43a0-8275-1285e266492b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.071837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.072506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.072908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.073188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.074014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:50.074342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.075915 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c301b-1c98-43ad-af98-5aaab8f084f6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.085340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.085512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 444/882] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:05:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:50.085594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.085594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.085746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b21ab-57be-4d08-9ba1-e531553684e6 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.085820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.085889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b21ab-57be-4d08-9ba1-e531553684e6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.085889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b21ab-57be-4d08-9ba1-e531553684e6 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.086019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:50.086019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.086019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40137589-77f3-4528-816a-fc46db254d16 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.087168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 445/883] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:50.088202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b21ab-57be-4d08-9ba1-e531553684e6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.098164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 439/884] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:50.099676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.100059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.100353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.118532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:50.119741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:50.189877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 440/885] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:50.195586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.205441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b21ab-57be-4d08-9ba1-e531553684e6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.222915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:50.228345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:50.246554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.247530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.247823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.248103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.248977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:50.249670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.251054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.256067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 446/886] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:05:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:50.256734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.330959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde7e50-397b-4c8e-a5b8-67b5e0193e4c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.370938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.371759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.372048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.372332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.381413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.382915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.392219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452949ec-b9e1-4732-8faf-2b6bcd4b6000 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:50.399412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:50.400458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:50.401408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:50.405472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 441/887] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:05:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:50.406786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.450231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346ad6d-7982-4cfe-8172-c226ed151bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.450907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ad6d-7982-4cfe-8172-c226ed151bb8 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.451292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ad6d-7982-4cfe-8172-c226ed151bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.451576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346ad6d-7982-4cfe-8172-c226ed151bb8 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.452315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ad6d-7982-4cfe-8172-c226ed151bb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.453688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346ad6d-7982-4cfe-8172-c226ed151bb8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.475104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 447/888] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:05:50 2022] POST /identity/v3/services => generated 269 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:50.507633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:50.530659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08c017-5a2e-4d0d-a215-7e1bb342b80c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.564637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510311c-b11d-4335-bd30-1a5635f7810f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.564950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510311c-b11d-4335-bd30-1a5635f7810f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.565209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510311c-b11d-4335-bd30-1a5635f7810f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.566974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 448/889] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:50.572392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.572684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.572957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.577784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.578722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.579962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.580261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.581136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:50.581455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.583081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.596213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:50.598089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:50.607141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 442/890] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jun 29 11:05:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:50.615010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.666848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:50.701190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 449/891] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:50.729391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.737975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac8faa-7ea7-4dea-a3e2-206b9c7ac588 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.784046 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.785941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.786378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.786852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.798708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:50.850260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619e1fe-4c9b-408d-bf72-c74474ac4a76 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:50.878159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.880548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.893471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:50.895296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:50.895591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:50.895874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:50.896954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:50.898746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:50.915147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:50.916418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:50.917663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 450/892] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:50.922275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:50.964962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.023253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 443/893] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:05:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:05:51.029069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.046120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074754de-3748-4375-99c6-fe956d43ffeb None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.065433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.083571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.084429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.084818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.085202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.086016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:51.086437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.087923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.097974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 451/894] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:51.098814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.142534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f245c3-aae4-45b3-a838-b9d13768f010 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.179973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.180989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.181440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.181863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.193813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.195502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.202632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c2629-2b69-4394-9571-84ba1466b76a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.204382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:51.216683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:51.217606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:51.218536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:51.218536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:51.218536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:51.218536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:51.225260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 444/895] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:51.226785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.241385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.242177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.242536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.242894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.243712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:51.244099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.245537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.255314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 452/896] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:51.257345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.322567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.340783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ff6cf-f077-4a54-8d85-0ec94ba8499d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.362265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f1c38-d2e7-484c-866c-89d2dccdd4bf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.379401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.380364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.380896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.381357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.382264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:51.382751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.384413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.397564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 445/897] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:51.400342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.401601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.402073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.402357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.403189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] RBAC: Adding query filter params (interface=public, service_id=c60d09a8d26147afa10a180cff3828c8, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:51.403510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.404386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.404880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.416104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 453/898] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/endpoints?service_id=c60d09a8d26147afa10a180cff3828c8&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:51.419714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.536569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31a78-eb1b-46b4-a0da-2b8290af4eec None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.543452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.547154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0fa19-adf3-47ad-a110-9ff6013f193c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.586432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.587918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.588391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.588819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.592062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.592831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.593217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.593597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.594377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.596008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.596981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.599440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.608957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 454/899] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:51.620867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:51.621850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:51.622754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:51.623687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 446/900] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:51.630184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.736336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.745402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae02f0-cb18-40b8-9c02-f13080405f8f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.788024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.789057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.789561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.790044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.791064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:51.791664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.793365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f64e2-942d-4456-bdd0-4f38cce8cbae None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.807965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 455/901] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:51.814006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:51.823718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:51.930300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5961f7-8385-45ba-b912-f05720bf7eef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:51.973401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:51.974486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:51.974973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:51.975491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:51.976571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] RBAC: Adding query filter params (role.id=a6be1b4fe8f246d08064b3f019184375, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=843ec60c1cce46738de1afa2accae5fc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:51.977088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:51.978818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efca5c9-86fb-445b-84d2-e3da7f984e6b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:51.985657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 447/902] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:05:51 2022] GET /identity/v3/role_assignments?user.id=843ec60c1cce46738de1afa2accae5fc&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=a6be1b4fe8f246d08064b3f019184375 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:52.392370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a05653-bd50-4668-b27a-28f2f2de750e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:52.392781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a05653-bd50-4668-b27a-28f2f2de750e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:52.392959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a05653-bd50-4668-b27a-28f2f2de750e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:52.395150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 456/903] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:52.400424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f728cfe-1654-4f8a-8af5-e6a912757715 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:52.400874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f728cfe-1654-4f8a-8af5-e6a912757715 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:52.400971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f728cfe-1654-4f8a-8af5-e6a912757715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:52.418823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9f728cfe-1654-4f8a-8af5-e6a912757715 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:52.420066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9f728cfe-1654-4f8a-8af5-e6a912757715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:52.484618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:52.490151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 448/904] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:52.513499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a05653-bd50-4668-b27a-28f2f2de750e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:52.588000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ac271-21a3-4fd5-991c-2cb40383c237 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:52.588323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ac271-21a3-4fd5-991c-2cb40383c237 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:52.588573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ac271-21a3-4fd5-991c-2cb40383c237 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:52.590166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 449/905] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:52.595553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:52.595840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:52.596270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:52.613388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:52.614679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:52.624983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a05653-bd50-4668-b27a-28f2f2de750e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:52.664660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:52.665254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:52.665544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:52.665837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:52.666539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:52.668139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:52.688619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 457/906] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:05:52 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:52.710228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 450/907] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:52.736649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:52.757312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:52.867411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1b12-a612-41cc-bd88-b4bbe934740e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:52.905523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:52.906347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:52.906636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:52.906981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:52.907683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:52.909052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:52.922219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:52.923387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:52.924245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 458/908] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jun 29 11:05:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:52.932500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:53.046530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0096-d015-440a-8a9b-3fb94a37340a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:53.074164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:53.085782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:53.086466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:53.086755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:53.087031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:53.087769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:53.088082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:53.089456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:53.094921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 451/909] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:53.100546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:53.204740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:53.229543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e8b9-b1a4-46d6-bd7e-f251bbb729d5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:53.264606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:53.265278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:53.265567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:53.265849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:53.266555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:53.266864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:53.268255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:53.273703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 459/910] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:53.279398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:53.382108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c990dd-d35f-4712-86e9-65e39b352134 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:53.417124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:53.417870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:53.418071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:53.418355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:53.419172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] RBAC: Adding query filter params (interface=public, service_id=3e341f676fa84872a3fbcb89bb656ec4, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:53.419495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:53.420868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aa2d7f-a0d5-43f9-a837-3e29d44054ed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:53.429158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 452/911] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:05:53 2022] GET /identity/v3/endpoints?service_id=3e341f676fa84872a3fbcb89bb656ec4&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:53.434530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:53.538665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806fb3f-280b-4844-a240-42542c33b039 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:53.574632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2f72b-62c5-497c-a28a-52480cde82ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:53.575658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f72b-62c5-497c-a28a-52480cde82ca None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:53.576161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f72b-62c5-497c-a28a-52480cde82ca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:53.576629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2f72b-62c5-497c-a28a-52480cde82ca None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:53.577523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2f72b-62c5-497c-a28a-52480cde82ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:53.579143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2f72b-62c5-497c-a28a-52480cde82ca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:53.585866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 460/912] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:05:53 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:05:53.816217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e72b-2efd-414f-9601-bcc4ff53fa6b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:53.816518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e72b-2efd-414f-9601-bcc4ff53fa6b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:53.816806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e72b-2efd-414f-9601-bcc4ff53fa6b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:53.819385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 453/913] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:53.827406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:53.827704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:53.828044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:53.843316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:53.850485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:53.851834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:53.928676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 461/914] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:53.951889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e72b-2efd-414f-9601-bcc4ff53fa6b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.012548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:54.060591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e72b-2efd-414f-9601-bcc4ff53fa6b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.099657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.100384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.100667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.100942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.101593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:54.102971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-95c610a5-9422-4d6f-8b1d-68ad762162c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:54.115345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:54.116374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:54.117225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 454/915] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:54.123110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.194988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b492a2-8003-4589-81c4-a14b07829ee2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.195340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b492a2-8003-4589-81c4-a14b07829ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.195593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b492a2-8003-4589-81c4-a14b07829ee2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.197075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 455/916] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:54.202152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.202717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.203239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.221177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:54.222842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:54.237671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d6da7-e592-4ea0-819f-aae9220d3a59 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.278813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.279881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.280385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.280857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.281761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:54.282279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:54.283866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:54.286275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:54.291690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 462/917] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:54.297507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.309866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 456/918] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:54.332511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.388381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:54.412192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c3519-5d18-4e5f-97a1-ed8d7d3f7d70 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.444892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9dec2-1bdc-49c0-ab64-7a1f3572bd71 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.448694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.449370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.449656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.449936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.450642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:54.450952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:54.452335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:54.457802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 463/919] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:54.463158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.486833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.488650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.489145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.489639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.500398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:54.509344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:54.510350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:05:54.511284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:54.512422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 457/920] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:54.518248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.550184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:54.601540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a808bc-e588-4319-82bd-17f6ef6f560c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.633343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee6632-d953-4b7f-bfd5-b93ca65f91ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.643247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:54.652156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.652823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.653108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.653384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.654131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:54.655508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:54.679116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 464/921] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:05:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:54.687083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.687789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.688063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.688389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.689150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:54.689460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:54.690917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3ba4-ff35-4f6e-8937-dbad8300f153 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:54.702134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 458/922] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:54.707989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.830169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e65814-5dbe-4aca-9e96-6105c77eb09c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:54.837477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86a4d5-81b1-4e3b-b0bb-540a3b98b8db None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.837793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86a4d5-81b1-4e3b-b0bb-540a3b98b8db None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.838030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86a4d5-81b1-4e3b-b0bb-540a3b98b8db None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.839412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 459/923] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:54.844545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.844842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.845122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.859809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:54.869190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:54.870651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:54.882366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:54.883901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:54.883901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:54.883901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:54.896213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:54.897595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:54.915880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:54.916819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:54.918022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:54.918022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:54.918022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:54.918022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:54.918022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 465/924] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:54.924518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:54.962225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 460/925] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:54.985368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.041493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82b625-267c-49d1-8a21-7573aba8ce19 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.077377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.078044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.078331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.078611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.079366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:55.079676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.081040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.083053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.089744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e6e8d-8a07-49e8-a787-e2d3c0bdcb46 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.094255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 466/926] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:55.101113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.132185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.132996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.133279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.133551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.134204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.135095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.135910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:55.150519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:55.151883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:55.152946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:55.158101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 461/927] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:55.158923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.215012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091b3c7-e4ec-4dc3-bfac-87b1a219e45d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.253330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.254642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.255417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.255870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.265357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.267460 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.271803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beef1f-bf69-468a-a243-1a67d1738959 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:55.287650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:55.288845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:55.290036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:55.292820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 467/928] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:55.298582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.316420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.317097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.317386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.317667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.318381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:55.318693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.320819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.331080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 462/929] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:55.332899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.362299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.406450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.415644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544796b7-4005-4b8a-8fa8-76fab370e23a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.450330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bda99-45ba-4bc7-ac87-ec3787d3f157 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.451630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.452411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.452843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.453194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.454614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:55.454614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.456092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.479583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 468/930] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:55.480901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.496575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.497260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.497552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.497843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.498554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:55.498875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.500948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.512034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 463/931] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:55.513452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.595292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbde67-2a8d-4d44-8500-ec25ad9611ce None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.611655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.628308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f93dbe-0837-498b-b70d-47c3a3e161e6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.633860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.634700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.634988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.635300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.645995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.647476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:55.665797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:55.666714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:55.667626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:55.667626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:55.667626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:55.667626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:55.671568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 469/932] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:55.672828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.674283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888049-0754-4420-9200-5093a18da560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.675206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888049-0754-4420-9200-5093a18da560 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.676220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.676718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888049-0754-4420-9200-5093a18da560 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.678137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888049-0754-4420-9200-5093a18da560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.679166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888049-0754-4420-9200-5093a18da560 None admin] RBAC: Adding query filter params (interface=public, service_id=4a32839d9b624f4c8773a5d506d52c40, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:55.679693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888049-0754-4420-9200-5093a18da560 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.681407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888049-0754-4420-9200-5093a18da560 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.691340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 464/933] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/endpoints?service_id=4a32839d9b624f4c8773a5d506d52c40&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:55.694569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888049-0754-4420-9200-5093a18da560 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.778383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab02de1-b4d9-4222-8b02-6107b283654c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.805600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888049-0754-4420-9200-5093a18da560 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:55.812454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.813122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.813440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.813717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.814428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:55.814733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.816675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8aa75-8c16-4855-8e8c-27caeae1eeb9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.828576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 470/934] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:55.829842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59177f0-b6a7-4ed5-9a0c-728ea5f1ef3f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.830131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59177f0-b6a7-4ed5-9a0c-728ea5f1ef3f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.830411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59177f0-b6a7-4ed5-9a0c-728ea5f1ef3f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.831857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 471/935] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:55.833884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59177f0-b6a7-4ed5-9a0c-728ea5f1ef3f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:55.851022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c4edb-e54a-4295-a251-23ab9ddac316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:55.851723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c4edb-e54a-4295-a251-23ab9ddac316 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.852014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c4edb-e54a-4295-a251-23ab9ddac316 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.852301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c4edb-e54a-4295-a251-23ab9ddac316 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.852992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c4edb-e54a-4295-a251-23ab9ddac316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:55.854364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c4edb-e54a-4295-a251-23ab9ddac316 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:55.860497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 465/936] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:05:55.861737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:55.862036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:55.862323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:55.882121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:55.883394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:55.897379 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.922106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:55.979074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 466/937] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:55.985130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59177f0-b6a7-4ed5-9a0c-728ea5f1ef3f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.002746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:56.048188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.049814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.050108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.050425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.060577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.062004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:56.078794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:56.079819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:56.080743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 472/938] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:56.086179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:56.139114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3405eea-9e19-49ad-89ee-bd7afb89df4b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.186856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.188579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.189038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.189708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.191614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.193237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.193622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7da2-eb1b-4e7a-af23-8e102f13f5e9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:56.208613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:56.209767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:56.210637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 467/939] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jun 29 11:05:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:56.215846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:56.226763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:56.231216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:56.248168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.249449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.249888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.250831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.252089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:56.252792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.255631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.273055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 473/940] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:05:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:56.278597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:56.347998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a45f6-fac1-4de9-a3df-427fac399d58 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.386550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef47e8e-6989-4ec7-b8b5-1a5a77fefba0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.390223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.391118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.391550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.391969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.392843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:56.393310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.395523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.404077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 468/941] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:56.409188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:56.435763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.437159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.437467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.437997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/843ec60c1cce46738de1afa2accae5fc/roles/a6be1b4fe8f246d08064b3f019184375` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.442198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=843ec60c1cce46738de1afa2accae5fc, role_id=a6be1b4fe8f246d08064b3f019184375)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.444323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.467118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 474/942] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:05:56 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/843ec60c1cce46738de1afa2accae5fc/roles/a6be1b4fe8f246d08064b3f019184375 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:05:56.505090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:56.535453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aa3b6-e8af-41a2-9324-b6ba4198dbd1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.585199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.585927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.586217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.586496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.587252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:56.587564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.589089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773632c6-e177-4fd3-b25b-53c54c67f91c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.595463 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 469/943] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:56.601857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:56.668686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:56.731530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af9a5-7dee-44f0-801c-80bbd4714d31 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:56.767737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe72b3-09e0-4538-b21d-261f5aa173c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:56.768784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe72b3-09e0-4538-b21d-261f5aa173c9 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.769830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe72b3-09e0-4538-b21d-261f5aa173c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.770318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe72b3-09e0-4538-b21d-261f5aa173c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.771371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe72b3-09e0-4538-b21d-261f5aa173c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:56.772994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe72b3-09e0-4538-b21d-261f5aa173c9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:56.799497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 475/944] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:05:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:56.874199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890842-f775-4e84-b5f5-da34f2efc08a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.874527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890842-f775-4e84-b5f5-da34f2efc08a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.874764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890842-f775-4e84-b5f5-da34f2efc08a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.876464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 470/945] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:56.882376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:56.882988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:56.883499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:56.902579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:56.904237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:56.993157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 476/946] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:57.015900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890842-f775-4e84-b5f5-da34f2efc08a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:57.126219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890842-f775-4e84-b5f5-da34f2efc08a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:57.161924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:57.162900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:57.163395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:57.163862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:57.164752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:57.166419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:57.167992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING keystone.server.flask.common [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 11:05:57.176418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:57.189687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.sql.core [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 11:05:57.189687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 11:05:57.189687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [parameters: {'id': '7801f219c5424c5b89f629d6f07bd129', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 11:05:57.189687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80058) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7801f219c5424c5b89f629d6f07bd129.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7801f219c5424c5b89f629d6f07bd129. Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 11:05:57.198204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 11:05:57.199027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application yield resource Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application next(self.gen) Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise self.value Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application session.commit() Jun 29 11:05:57.200010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.session.flush() Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application compat.raise_( Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 11:05:57.200907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 11:05:57.201818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application conn.query(q) Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application result.read() Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 11:05:57.202598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [parameters: {'id': '7801f219c5424c5b89f629d6f07bd129', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:57.205013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:57.206931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7801f219c5424c5b89f629d6f07bd129. Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:57.213327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 471/947] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Jun 29 11:05:57 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:57.214708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:57.232662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:57.312409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c97786-c06d-4635-8d30-8645eb41a9a0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:57.349614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:57.350420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:57.350706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:57.350982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:57.358167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:57.359638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1c881fb2-8ae3-4de7-854c-5a8db71f4303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:05:57.374030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:57.376051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:57.378148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 477/948] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:57.381543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:57.486968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08115a0-c534-466f-9549-9c4d234bc4a8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:57.522925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:57.523765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:57.524021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:57.524299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:57.525097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:57.525404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:57.527101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4604-d9a0-4c04-831b-bf4c9ca572bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:57.548062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 472/949] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:57.992658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72490-89c4-44fe-84b8-f2fc4231e9fd None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:57.993308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72490-89c4-44fe-84b8-f2fc4231e9fd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:57.993308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72490-89c4-44fe-84b8-f2fc4231e9fd None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:57.994855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 478/950] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:58.003371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.003371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.003371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.024101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:58.025604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:58.083423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:58.105200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 473/951] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:58.128332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e72490-89c4-44fe-84b8-f2fc4231e9fd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:58.217181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:58.236173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e72490-89c4-44fe-84b8-f2fc4231e9fd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:58.272059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:58.273208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.273723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.274194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.275033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:58.276603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:58.289243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:58.290249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:05:58.291128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:58.293890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 479/952] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:05:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:58.300152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:58.414274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a4f83-5fd7-41ad-9d9d-b76f7decef4b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:58.449824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:58.450904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.451412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.451913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.452816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:58.453378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:58.454994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:58.461029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 474/953] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:05:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:58.466752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:58.573959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308ee25-ab86-4f69-8cba-531d76c574f7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:58.609178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:58.609848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.610135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.610417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.611159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:58.611470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:58.612871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab4c7f-b905-4291-ae66-e1e863ba3e5b None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:58.618401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 480/954] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:05:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:58.624046 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:58.679555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0601394-6473-425c-8281-12355f6011e5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.680517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0601394-6473-425c-8281-12355f6011e5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.681012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0601394-6473-425c-8281-12355f6011e5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.683364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 481/955] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:58.688407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.689175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.689674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.690482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:58.716273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:58.718035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:58.732056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:58.747901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7979e8-dfbd-490f-b1a8-503f5cfe25e8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:58.785627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:58.786429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.786780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.787175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:58.788010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:58.789421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:58.802656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 482/956] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:58.813020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 475/957] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:05:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:05:58.826992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:58.946358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf5876-fa0a-4a67-a540-420444331b7d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:58.990405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a41dc5-2250-44de-8539-55f26e8dc91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:58.990607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41dc5-2250-44de-8539-55f26e8dc91e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:58.995058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41dc5-2250-44de-8539-55f26e8dc91e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:58.995058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a41dc5-2250-44de-8539-55f26e8dc91e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.005309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a41dc5-2250-44de-8539-55f26e8dc91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:05:59.013081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-10a41dc5-2250-44de-8539-55f26e8dc91e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:05:59.015400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:59.016373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:59.017837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 483/958] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jun 29 11:05:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:59.024950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.037321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a63b4-9ae5-4498-8057-34931b29f7af None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.037614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a63b4-9ae5-4498-8057-34931b29f7af None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.037896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a63b4-9ae5-4498-8057-34931b29f7af None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.039585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 484/959] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:05:59.044796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.045341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.045627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.065922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:59.067143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:59.142910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 485/960] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:05:59.167511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.168138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff01e7-160b-4fe2-8028-fa047191079e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.171446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.217502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.218461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.218955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.219356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.220216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:59.220631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.222357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.231801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 476/961] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:59.237433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.276466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5174a-4993-4d05-9a8e-d8837e693774 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.306046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.314570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.315593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.316795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.317936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.318143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.319951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:59.333352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:59.334545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:05:59.335450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:05:59.339673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 486/962] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:59.340632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.355631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98566af-7044-4c46-b393-b016bdfafa69 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.393689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.394634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.398659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.398659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.409163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.411383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:05:59.430402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:59.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:59.432691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:05:59.432691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:05:59.432691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:05:59.432691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:59.438685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 477/963] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:05:59.439744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.455592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9fde2-6f1b-42c8-8c75-a569cd1dbcc0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.461550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.494015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.494920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.495499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.495921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.496882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:59.497340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.498829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.504933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 487/964] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:05:59.515759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.553121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f3074-cd07-4899-a381-7297ba78782a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.583393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.594521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.595458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.595941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.596363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.597897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:59.598483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.600058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.619620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 478/965] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:59.620515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.634397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddb9d-b8ae-4fe4-a7fd-b2197fa809a0 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.671715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.672764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.673198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.673623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.674490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:59.674991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.676704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32352e7-2634-4311-87e4-a744d0ae29fb None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.687494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 488/966] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:05:59.708216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.724907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba419d-135d-45c7-91aa-4d29612e17c2 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.725687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba419d-135d-45c7-91aa-4d29612e17c2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.726173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba419d-135d-45c7-91aa-4d29612e17c2 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.728193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 489/967] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:05:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:05:59.735248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d5082-b459-4d46-b93f-e5c243d2354e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.735435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.735435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.735435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.754545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:05:59.755982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:05:59.776342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.777488 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.777926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.778507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.787569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.789119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:05:59.807335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:05:59.808368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:05:59.809320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 479/968] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:05:59.817037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.855164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 490/969] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:05:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:05:59.873712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:05:59.926308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:05:59.932636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb2301-3523-45eb-baaf-6c6478614af3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:05:59.982400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:05:59.983387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:05:59.983680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:05:59.983958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:05:59.984806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:05:59.985114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:05:59.986572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:05:59.992713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555352b5-aaaa-4409-9d9a-c7adb122e92b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.010861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:00.033785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 480/970] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jun 29 11:05:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:00.036311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:00.043949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.045399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.046350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.046842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.048148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.050382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.052482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING keystone.server.flask.common [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 11:06:00.068305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.sql.core [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 11:06:00.068305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 11:06:00.068305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [parameters: {'user_id': 'a07335364277442c9d2abe3b6d70470d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 11:06:00.068305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80059) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application conn.query(q) Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application result.read() Jun 29 11:06:00.093080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 11:06:00.094029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application next(self.gen) Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application yield resource Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application next(self.gen) Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise self.value Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application session.commit() Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 11:06:00.095030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.session.flush() Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application compat.raise_( Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 11:06:00.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 11:06:00.096873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application conn.query(q) Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application result.read() Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 11:06:00.099667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a07335364277442c9d2abe3b6d70470d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:00.101766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 11:06:00.103797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 491/971] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jun 29 11:05:59 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:00.106533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:00.181128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28183c-e1b8-4690-bc59-e80efb9f6460 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.220516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e88f06-7f1a-498d-bc6c-9ff9aeeb1c60 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.228140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.229490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.229967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.230418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.236492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:00.268728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.270056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.270780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.271239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.280140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.281949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:06:00.297013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:00.297972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 11:06:00.298917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:00.301653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 492/972] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:00.308228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:00.312607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:00.321564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.323828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.426038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47892-3e7c-416d-a4a8-3e9a8d197825 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.452175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 481/973] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:00 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:00.453498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:00.462704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.463719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.464245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.464780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.465787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:00.466317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.467981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.507026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 493/974] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jun 29 11:06:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:00.562231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:00.568997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ed971-5c7b-409a-9f68-4db801644e1c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.608324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.609539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.610070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.610553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.625596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.627104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:00.647409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:00.648381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:00.649349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:00.649349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:00.649349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:00.649349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:00.653593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 482/975] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:00.655024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:00.691624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:00.766455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e965d577-af8d-48ea-a68e-74de10d72577 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.803936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.804620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.804909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.805201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.805922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:00.806234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.807632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.823131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 494/976] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:00.827199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:00.936826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd8e1e0-b44a-4c66-abfc-e02e1ad77400 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:00.970360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:00.971182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:00.971473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:00.971754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:00.979171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:00.980626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-57f4ea44-d21f-4271-bad0-218535103f4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:06:00.994432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:00.995619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:00.996742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:01.001775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 483/977] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:01.003161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.019002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d333c-c770-4fea-b8d3-215ddd13b377 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.019797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d333c-c770-4fea-b8d3-215ddd13b377 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.020087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d333c-c770-4fea-b8d3-215ddd13b377 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.021478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 484/978] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:06:01.026570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.026859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.027188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.043994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:01.045204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:01.047153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.101929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.115258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741f49d-4ddf-4e3c-9966-227bc1dc97ca None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.124800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 485/979] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:01.147823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.152984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.153650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.153938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.154220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.155001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:01.155346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.156764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.182179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 495/980] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:01.183258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.259841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493c198-d490-4318-a48c-d7382db02ad8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.287737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e47b4d-6191-4908-b0e5-c7a57af1ffaf None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.299680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.300525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.300817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.301098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.301752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.303423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:01.315350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:01.316426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:01.317285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 486/981] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:01.322445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.325270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.327448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.328236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.328551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.328844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.329710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] RBAC: Adding query filter params (role.id=a6be1b4fe8f246d08064b3f019184375, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=843ec60c1cce46738de1afa2accae5fc) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:01.330099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.332063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.347066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 496/982] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/role_assignments?user.id=843ec60c1cce46738de1afa2accae5fc&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=a6be1b4fe8f246d08064b3f019184375 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:01.442756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8affec-92c5-4415-8831-66fabac6bc06 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.479128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.479807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.480097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.480380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.481101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:01.481417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.482802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.488505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 487/983] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:01.494131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.514827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.604703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090440f-2452-4a93-91a2-6b53066a850d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.638727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.639435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.639721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.639998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.640708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:01.641015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.642367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6c079-a03d-4dbc-a128-0c1ca5b7b185 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.647553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 497/984] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:01.653234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.720562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.757994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a12a7b-33d4-4997-916e-5f1c821547fa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.781988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8645-316d-42c4-b8b2-65902f3ec855 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.782293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8645-316d-42c4-b8b2-65902f3ec855 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.782580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8645-316d-42c4-b8b2-65902f3ec855 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.784218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 498/985] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:01.789622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.789924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.790216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.795158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.795836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.796168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.796408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.797217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] RBAC: Adding query filter params (interface=admin, service_id=4a32839d9b624f4c8773a5d506d52c40, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:01.797537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.798957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.805246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 488/986] 10.222.0.48 () {56 vars in 1249 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/endpoints?service_id=4a32839d9b624f4c8773a5d506d52c40&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:01.810503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.810707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:01.812360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:01.898373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 499/987] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:01.916109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:01.924299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c04b5-1a96-42f1-937a-4f68fa4d884a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:01.928618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.955617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:01.963211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde195-18a0-4420-8226-b31a78b15e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:01.964054 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde195-18a0-4420-8226-b31a78b15e60 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:01.964183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde195-18a0-4420-8226-b31a78b15e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:01.964425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde195-18a0-4420-8226-b31a78b15e60 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:01.965100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde195-18a0-4420-8226-b31a78b15e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:01.966471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde195-18a0-4420-8226-b31a78b15e60 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:01.973175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 489/988] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:06:01 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:06:02.034266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729e39-e746-41b1-94cc-9c90f068d1e1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:02.075936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431f264-cbc3-4c82-9ab2-9fd13fea9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:02.076628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431f264-cbc3-4c82-9ab2-9fd13fea9685 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:02.076918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431f264-cbc3-4c82-9ab2-9fd13fea9685 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:02.077197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431f264-cbc3-4c82-9ab2-9fd13fea9685 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:02.077950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431f264-cbc3-4c82-9ab2-9fd13fea9685 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:02.079370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431f264-cbc3-4c82-9ab2-9fd13fea9685 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:02.095655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 500/989] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:06:01 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:03.402213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684828b-788c-4f6c-bbf9-e13a51cbb30f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:03.402764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684828b-788c-4f6c-bbf9-e13a51cbb30f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:03.402764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684828b-788c-4f6c-bbf9-e13a51cbb30f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:03.404308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 490/990] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:03.409105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:03.409478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:03.409721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:03.426709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:03.428148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:03.489410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:03.503196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 501/991] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:03.524874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684828b-788c-4f6c-bbf9-e13a51cbb30f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:03.626568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684828b-788c-4f6c-bbf9-e13a51cbb30f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:03.662011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:03.662716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:03.662996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:03.663296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] PATH_INFO: `/v3/services/image` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:03.663951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:03.665305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:03.677065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:03.678360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:03.679253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:03.686287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 491/992] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jun 29 11:06:03 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:03.686419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:03.791359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd3725-b968-4909-bc4f-927654d0f68f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:03.826048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:03.826718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:03.827005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:03.827311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:03.828011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] RBAC: Adding query filter params (name=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:03.828320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:03.829678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ea401-5af6-4c24-83ba-9d15600b9385 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:03.836115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 502/993] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:03.840549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:03.899502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:03.943766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94149d-220c-4e49-812a-bcf4fb0519cf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:03.977558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:03.978220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:03.978504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:03.978783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:03.979517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] RBAC: Adding query filter params (type=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:03.979827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:03.981200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712490-25b0-41ba-830c-e2e8c01b6d46 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:03.987015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 492/994] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:04.033954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37245-869e-4bd7-aaa3-4625a6516cd5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.034261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37245-869e-4bd7-aaa3-4625a6516cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.035247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d37245-869e-4bd7-aaa3-4625a6516cd5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.036792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 503/995] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:04.042678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.042986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.043300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.061866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:04.063112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:04.127670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc5883-a400-4fb9-ba9a-b272b0c48c95 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.128079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc5883-a400-4fb9-ba9a-b272b0c48c95 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.128488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc5883-a400-4fb9-ba9a-b272b0c48c95 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.129965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 504/996] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:06:04.135141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.135432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.135716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.143131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 493/997] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:04.159356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:04.161137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:04.165976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.217235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:04.218725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:04.233339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 505/998] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:04.256637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.268179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c64f-eea7-4014-b7e7-95b025380b23 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.305044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.305859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.306150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.306431 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.307120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.308498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:04.320788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:04.322075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:04.323121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 494/999] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:04.327682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.368279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613a8a0-3efc-498c-bb7c-eac727954abf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.404475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.405280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.405566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.405843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.406494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.408338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:04.421621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:04.423132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:04.423998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 506/1000] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:04.429351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.437510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528dc5b-b303-4e6b-b386-ea990a9bebbb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.457058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:04.479501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.480092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.480380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.480662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.481369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:04.481682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.483061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.484141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:04.493068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 495/1001] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:04.493899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.537739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca25db-5eae-47fb-b554-e6f6b6771fe1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.574469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.575636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.576229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.576516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.577221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:04.577532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.579008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.584480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 507/1002] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:04.589689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.593846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7813cc-9d60-4fac-919e-5f798ae873ca None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.631675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.631675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.631993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.632121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.632823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:04.633136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.634507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.639788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 496/1003] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:04.645988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.694788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:04.703935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1521d7-cc8d-488e-855c-6770f401fe65 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.724351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:04.743938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440460-af84-4857-abeb-324850c7fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.744548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440460-af84-4857-abeb-324850c7fbab None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.744815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440460-af84-4857-abeb-324850c7fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.745101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77440460-af84-4857-abeb-324850c7fbab None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.745823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440460-af84-4857-abeb-324850c7fbab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:04.746135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440460-af84-4857-abeb-324850c7fbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.747543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77440460-af84-4857-abeb-324850c7fbab None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.753055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 508/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:04.757673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982bdb4-34f4-4583-b2ed-38176dc20094 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.759157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440460-af84-4857-abeb-324850c7fbab None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:04.793721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.794475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.794755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.795052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.795791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.797149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.812476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 497/1005] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:06:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:06:04.868946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77440460-af84-4857-abeb-324850c7fbab None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:04.914492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:04.915517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:04.916020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:04.916480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:04.917456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] RBAC: Adding query filter params (interface=public, service_id=98dcdb7913124c24a894bcc6e99ce17d, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:04.917962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:04.919582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196b4b-b24b-4064-94de-b45b2a63d73f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:04.925726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 509/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/endpoints?service_id=98dcdb7913124c24a894bcc6e99ce17d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:04.931803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:05.041406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26186c-cd0a-467f-a013-91ff8ad9b0de None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:05.043879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:05.081093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879e910-d7d1-4efb-821d-f9d17355e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:05.082286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879e910-d7d1-4efb-821d-f9d17355e606 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:05.082569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879e910-d7d1-4efb-821d-f9d17355e606 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:05.082843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879e910-d7d1-4efb-821d-f9d17355e606 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:05.083558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879e910-d7d1-4efb-821d-f9d17355e606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:05.084925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879e910-d7d1-4efb-821d-f9d17355e606 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:05.091357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 498/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:06:04 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:06:06.040529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6a72-2060-4355-bf5e-ff0026c5ecdd None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:06.041007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6a72-2060-4355-bf5e-ff0026c5ecdd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:06.041084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c6a72-2060-4355-bf5e-ff0026c5ecdd None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:06.042632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 510/1008] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:06.047545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9696e-fe84-41fc-ad51-da713890e197 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:06.047941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9696e-fe84-41fc-ad51-da713890e197 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:06.048142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9696e-fe84-41fc-ad51-da713890e197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:06.065169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-01c9696e-fe84-41fc-ad51-da713890e197 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:06.066872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-01c9696e-fe84-41fc-ad51-da713890e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:06.134900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 499/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:06.157928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6a72-2060-4355-bf5e-ff0026c5ecdd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:06.207848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:06.272131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c6a72-2060-4355-bf5e-ff0026c5ecdd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:06.307541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3648a-f5d7-47ac-a221-09f0c539808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:06.308198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3648a-f5d7-47ac-a221-09f0c539808f None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:06.308489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3648a-f5d7-47ac-a221-09f0c539808f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:06.308776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3648a-f5d7-47ac-a221-09f0c539808f None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:06.309511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3648a-f5d7-47ac-a221-09f0c539808f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:06.310869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3648a-f5d7-47ac-a221-09f0c539808f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:06.325465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 511/1010] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:06:06 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:06.877687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6eba6-2f35-4c33-bc0b-c1e9ae664d43 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:06.878059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6eba6-2f35-4c33-bc0b-c1e9ae664d43 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:06.878791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6eba6-2f35-4c33-bc0b-c1e9ae664d43 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:06.880354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 500/1011] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:06.885416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958c354-d22f-4b3f-9c26-8aeb73111db5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:06.885713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958c354-d22f-4b3f-9c26-8aeb73111db5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:06.885996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958c354-d22f-4b3f-9c26-8aeb73111db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:06.903103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1958c354-d22f-4b3f-9c26-8aeb73111db5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:06.904273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1958c354-d22f-4b3f-9c26-8aeb73111db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:06.978855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 512/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:06 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:07.002335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6eba6-2f35-4c33-bc0b-c1e9ae664d43 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:07.101137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:07.107724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6eba6-2f35-4c33-bc0b-c1e9ae664d43 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:07.128383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea517-62a5-40be-a419-6300b9c0a69a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.128855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea517-62a5-40be-a419-6300b9c0a69a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.128855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea517-62a5-40be-a419-6300b9c0a69a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.130384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 513/1013] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:06:07.134926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.135262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.135548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.144815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:07.145613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.145899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.146178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.147407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:07.148842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:07.150458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 501/1014] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:07.153244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:07.154427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:07.155908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:07.176955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:07.235364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 514/1015] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:07.251502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:07.259976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622d463-780c-45d8-8674-a72b557a8c22 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:07.295023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:07.295711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.295997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.296276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.296981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:07.298502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:07.333771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 502/1016] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:06:07 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:06:07.368673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37e377-a8af-4fbe-89ed-ed9a275c2f19 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:07.407414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:07.408274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.408570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.408846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.410058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:07.411485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:07.424233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:07.425373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:07.431864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 515/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:06:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:07.433342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:07.454140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:07.544744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd253734-79fe-4624-8355-3dc64815d1d5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:07.579584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:07.580263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.580635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.580924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.582178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:07.582489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:07.583886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:07.593269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 503/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:06:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:07.594446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:07.617690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:07.702445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e0895-d98a-437b-83f1-ef0b7167faa8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:07.737526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:07.738216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.738505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.738788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.739524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:07.739837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:07.741197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6523c9a-be53-4fcc-901b-fec460d0a3d8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:07.746259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 516/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jun 29 11:06:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:07.751912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:07.835536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:07.856107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad501b-d6c1-44ee-ae56-50f9348abd30 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:07.890170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e833c26-7bf1-4199-8a54-5f3ec102c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:07.890827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833c26-7bf1-4199-8a54-5f3ec102c5ac None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:07.891139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833c26-7bf1-4199-8a54-5f3ec102c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:07.891422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e833c26-7bf1-4199-8a54-5f3ec102c5ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:07.892176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833c26-7bf1-4199-8a54-5f3ec102c5ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:07.893544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e833c26-7bf1-4199-8a54-5f3ec102c5ac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:07.919063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 504/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:06:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:08.377422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105520cc-2619-4b7e-9638-7dd41d82b682 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:08.377939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105520cc-2619-4b7e-9638-7dd41d82b682 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:08.378019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105520cc-2619-4b7e-9638-7dd41d82b682 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:08.379940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 517/1021] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:08.385022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:08.385414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:08.385590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:08.402182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:08.403375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:08.479667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 505/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:08.502224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105520cc-2619-4b7e-9638-7dd41d82b682 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:08.587872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:08.605210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105520cc-2619-4b7e-9638-7dd41d82b682 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:08.640288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:08.640998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:08.641282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:08.641559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:08.642204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:08.643590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:08.660158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:08.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:08.664032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:08.665314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 518/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jun 29 11:06:08 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:08.669641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:08.732873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:08.773299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e51024-c7c5-4079-9b37-9a7789944e42 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:08.806775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:08.807460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:08.807746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:08.808024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:08.808719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:08.809029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:08.810392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:08.815369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 506/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:08.821297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:08.920259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876b17c-f661-4a35-a72a-1d12654e02e5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:08.953737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:08.954400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:08.954683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:08.954968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:08.955708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] RBAC: Adding query filter params (type=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:08.956017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:08.957924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:08.963011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 519/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:08.968650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:09.078136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa764378-702e-44a7-822c-2ff61ba912f9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:09.105325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:09.114935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:09.115663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:09.115950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:09.116220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:09.117031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] RBAC: Adding query filter params (interface=public, service_id=d98e20cff75a4902ada8e730e9ddd526, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:09.117344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:09.118737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dde76-8eec-4f08-be93-326ad2a4117d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:09.124847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 507/1026] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:06:08 2022] GET /identity/v3/endpoints?service_id=d98e20cff75a4902ada8e730e9ddd526&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:09.130671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:09.146407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:09.233429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188144c8-e0b2-4233-bbeb-10ea62a97463 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:09.266399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09a786-30b4-4f9e-b2e8-fedbce58243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:09.267080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a786-30b4-4f9e-b2e8-fedbce58243a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:09.267377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a786-30b4-4f9e-b2e8-fedbce58243a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:09.267669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09a786-30b4-4f9e-b2e8-fedbce58243a None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:09.268324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a786-30b4-4f9e-b2e8-fedbce58243a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:09.269733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09a786-30b4-4f9e-b2e8-fedbce58243a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:09.283066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 520/1027] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:06:09 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:06:09.418695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b401f-4352-4e6d-826a-e8bb82eba78d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:09.419245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b401f-4352-4e6d-826a-e8bb82eba78d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:09.419325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b401f-4352-4e6d-826a-e8bb82eba78d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:09.420637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 508/1028] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:09.426380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:09.426798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:09.427006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:09.444773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:09.445942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:09.515239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 521/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:09.539557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b401f-4352-4e6d-826a-e8bb82eba78d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:09.643334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b401f-4352-4e6d-826a-e8bb82eba78d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:09.678355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150092b-abdf-43cb-9378-a42f5fdb0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:09.679183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150092b-abdf-43cb-9378-a42f5fdb0e80 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:09.679467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150092b-abdf-43cb-9378-a42f5fdb0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:09.679740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150092b-abdf-43cb-9378-a42f5fdb0e80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:09.680908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150092b-abdf-43cb-9378-a42f5fdb0e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:09.682434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150092b-abdf-43cb-9378-a42f5fdb0e80 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:09.684222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 509/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:09.689809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:09.698113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:09.794377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cd9ad-352f-403c-962b-9ec99faaf004 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:09.828875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f435e-52e5-4e8b-8f13-d3ff27305ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:09.829544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f435e-52e5-4e8b-8f13-d3ff27305ea0 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:09.829830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f435e-52e5-4e8b-8f13-d3ff27305ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:09.830106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f435e-52e5-4e8b-8f13-d3ff27305ea0 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:09.830824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f435e-52e5-4e8b-8f13-d3ff27305ea0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:09.832846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f435e-52e5-4e8b-8f13-d3ff27305ea0 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:09.859095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 522/1031] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:06:09 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:10.052599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f38e3-983f-4ae2-9bb2-294548a64db5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.053077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f38e3-983f-4ae2-9bb2-294548a64db5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.053366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f38e3-983f-4ae2-9bb2-294548a64db5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:10.054756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 510/1032] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:10.059977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.060277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.060563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:10.078215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:10.079426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:10.142548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:10.158022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 523/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:10.182408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f38e3-983f-4ae2-9bb2-294548a64db5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:10.245201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:10.287575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f38e3-983f-4ae2-9bb2-294548a64db5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:10.322017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:10.322823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.323137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.323418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:10.333557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:10.341637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:10.342572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:10.343466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 511/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jun 29 11:06:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:10.350083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:10.454290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb821b-73bb-42f1-99d1-287d8ed802f6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:10.489786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:10.490457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.490745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.491024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:10.491792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:10.492100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:10.493458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:10.505956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 524/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:06:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:10.507201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:10.615246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ddf87-80c2-4dfd-b78a-a689fa5bfa79 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:10.634570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:10.649749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:10.650543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.650828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.651165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:10.662253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:10.663727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:10.681319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:10.682215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:10.683522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:10.683522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:10.683522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:10.683522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:10.683985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 512/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:10.688144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:10.745094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:10.794120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52111e9e-b869-473b-81e5-47b02bf025f7 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:10.828315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:10.828984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.829267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.829545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:10.830260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:10.830566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:10.831964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:10.843849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 525/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:10.849780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:10.950500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85256095-3b29-44fa-8125-2ae783c1fa70 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:10.984562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:10.985355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:10.985640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:10.985939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.001503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.001503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:06:11.016545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:11.017590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:06:11.018576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:11.020531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 513/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:11.024078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.125793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243af8-0823-4b08-8a4b-6098b1aa531a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.139542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.161529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.162200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.162488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.162769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.163626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:11.163941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.165354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d3a7-2fa5-4b5d-a99d-46e8c54afdd5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.187328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 526/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:11.188589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.222626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.292924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cc58b-3462-44ba-8016-9ec962331b3a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.324619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608331c5-a803-4939-a139-a3fa011f1a1f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.324913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608331c5-a803-4939-a139-a3fa011f1a1f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.325197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608331c5-a803-4939-a139-a3fa011f1a1f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.326552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 527/1040] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:06:11.327944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.328809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.329278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.329750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.331352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.332114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.332397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.348670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:11.349828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:11.404777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.406224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.422324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 528/1041] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:11.441392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.447647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.524712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 514/1042] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:11.525436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.562093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203266-b1c6-4602-becf-83cafd7dbe60 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.563830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.600775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.601568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.601858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.602142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] PATH_INFO: `/v3/services/image` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.602791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.604195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:11.616411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:11.617446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:11.618308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 529/1043] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:11.623775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.634642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be43d8-1b6b-41da-8f78-759b8aef0be5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.667116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.673650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.674451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.674854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.675696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.687197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.688746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:11.707542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:11.708493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:11.709439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:11.709439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:11.709439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:11.709439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:11.709439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 515/1044] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:11.714423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.731488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb358b8-794b-4ac2-8e99-82bb7977be68 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.775561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.776252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.776538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.777025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.777656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] RBAC: Adding query filter params (name=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:11.777927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.779426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.789181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 530/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:11.790177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.820986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.825329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ed2ba-5ec6-4302-97ae-e70648537a53 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.862043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.863330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.863619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.863896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.864609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:11.864913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.866271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.883253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 516/1046] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:11.883910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.892790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0ba8-e635-4263-a889-010be8225066 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:11.927763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:11.928682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:11.928968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:11.929242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:11.929938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] RBAC: Adding query filter params (type=image) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:11.930241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:11.931622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:11.931746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:11.937109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 531/1047] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:11.943108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:11.993894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0110263-2ba3-4c94-b010-409ebc1a4e28 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.029813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.030537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.031082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.031213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.038414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.039916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:12.040034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:12.046964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8191-3b14-464a-9dc6-e0104bad7d35 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-06400e73-6811-4f78-9bd5-c8c24d2869d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:06:12.055469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:12.056523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:12.057793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 517/1048] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:12.058390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fd9e-8184-446b-83a4-27638a6d4e0f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.058390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fd9e-8184-446b-83a4-27638a6d4e0f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.058390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fd9e-8184-446b-83a4-27638a6d4e0f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.059808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 518/1049] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:12.062227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fd9e-8184-446b-83a4-27638a6d4e0f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:12.084855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3023f24-c05f-4831-8f67-a77081fdf3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.085609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023f24-c05f-4831-8f67-a77081fdf3f3 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.085895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023f24-c05f-4831-8f67-a77081fdf3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.086173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3023f24-c05f-4831-8f67-a77081fdf3f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.086918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3023f24-c05f-4831-8f67-a77081fdf3f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.088302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3023f24-c05f-4831-8f67-a77081fdf3f3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:12.108174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 532/1050] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:06:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:06:12.109324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.109622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.109908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.136717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:12.138101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:12.177181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:12.184053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fd9e-8184-446b-83a4-27638a6d4e0f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.221272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 533/1051] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:12.224906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.224906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.224906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.224906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.225647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:12.226025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.227586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:12.241954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 519/1052] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:06:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:12.247928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:12.248986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:12.337340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:12.360351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8aec7-d537-4c6a-a404-bc27a592cc41 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.364861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455d15-ce4a-437f-9649-a7b8850d7a59 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.397660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.398453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.398750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.399058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.399909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] RBAC: Adding query filter params (role.id=a6be1b4fe8f246d08064b3f019184375, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=14b23668139e429bacd32a5d4fc0994e) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:12.400226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.401654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:12.403773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.404781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.405067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.405349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.407691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 534/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:12 2022] GET /identity/v3/role_assignments?user.id=14b23668139e429bacd32a5d4fc0994e&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=a6be1b4fe8f246d08064b3f019184375 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:12.417524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:12.425604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:12.426844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:12.428567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:12.431507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 520/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:12.433670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:12.545490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bda2b-bc00-4ca3-82dc-3664ad409212 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.584036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.584700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.584991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.585276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.586023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:12.586335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.587780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:12.596583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 535/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:12.603124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:12.637451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:12.716825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fce164-b571-46e3-8e4c-1b2af43e6f8a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.751524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.752700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.753664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.754088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] PATH_INFO: `/v3/users/eb7f88569a6845b1a20c228ad51e8f8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.768113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] RBAC: Authorizing `identity:get_user(user_id=eb7f88569a6845b1a20c228ad51e8f8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.770346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:12.776621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 521/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:12 2022] GET /identity/v3/users/eb7f88569a6845b1a20c228ad51e8f8f => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:12.778154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:12.787892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:12.884991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0049ec6-13cd-4390-82b2-50ecf2cbee77 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:12.920450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:12.921105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:12.921394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:12.921675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:12.995125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:12.998329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:13.005709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:13.104441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 536/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:13.105953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:13.185431 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:13.209185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567940-e6ea-4309-b572-44b99f2a313e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:13.244578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa86e13-6074-41a1-93bc-b285b812c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:13.245727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86e13-6074-41a1-93bc-b285b812c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:13.246162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86e13-6074-41a1-93bc-b285b812c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:13.246611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa86e13-6074-41a1-93bc-b285b812c8e5 None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:13.248097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa86e13-6074-41a1-93bc-b285b812c8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=41a03b34c5fa46eda9702b269a49533a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:13.249767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa86e13-6074-41a1-93bc-b285b812c8e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:13.257148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 522/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:13 2022] GET /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:13.258464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:13.359297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e96d0-08c8-457b-85d2-42a00f9eba1d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:13.367310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:13.395190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:13.395851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:13.396139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:13.396422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:13.397249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=41a03b34c5fa46eda9702b269a49533a, user.id=eb7f88569a6845b1a20c228ad51e8f8f) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:13.397567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:13.398984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479e2a0-c946-45bf-ae78-5d3f5d2d1556 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:13.411304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 537/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:13 2022] GET /identity/v3/role_assignments?user.id=eb7f88569a6845b1a20c228ad51e8f8f&scope.project.id=41a03b34c5fa46eda9702b269a49533a&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:14.174738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf31e4-e8d4-48ae-bfc1-8cef3da232a4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.175334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf31e4-e8d4-48ae-bfc1-8cef3da232a4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.175417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf31e4-e8d4-48ae-bfc1-8cef3da232a4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.176863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 523/1060] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:14.182045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39054-bd09-451c-b6c8-3bb0e937ed73 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.182461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39054-bd09-451c-b6c8-3bb0e937ed73 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.182664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da39054-bd09-451c-b6c8-3bb0e937ed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.199464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4da39054-bd09-451c-b6c8-3bb0e937ed73 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:14.200655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4da39054-bd09-451c-b6c8-3bb0e937ed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:14.271147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 538/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:14.293059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf31e4-e8d4-48ae-bfc1-8cef3da232a4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:14.394786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf31e4-e8d4-48ae-bfc1-8cef3da232a4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:14.428280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:14.428930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.429214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.429491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.440263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7698-b3d5-4879-a7a7-f1812db222e0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.441094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7698-b3d5-4879-a7a7-f1812db222e0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.441385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b7698-b3d5-4879-a7a7-f1812db222e0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.442902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 539/1062] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:14.445785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:14.448149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.448449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.448735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.465723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:14.466901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:14.510119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:14.511615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:14.538400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 540/1063] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:14.561523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:14.591611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:14.616766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 524/1064] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:14.622461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:14.668935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7399cc1-94df-45ad-a0ef-60996313ff3d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:14.669576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:14.713734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:14.714971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.715298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.715566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.727751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ca29a-c39b-47b7-8d95-55256a41c79f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:14.728118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:14.736219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:14.737241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:14.738632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 541/1065] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jun 29 11:06:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:14.743950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:14.765934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:14.766732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.767018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.767327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.777519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:14.779014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:14.796795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:14.797710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:14.798608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:14.798608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:14.798608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:14.798608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:14.798608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 525/1066] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:14.805261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:14.847623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:14.859650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef0502-2e6a-48c1-bb1a-5b962fcb3502 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:14.896127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:14.896795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.897078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.897353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.898091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:14.898404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:14.899796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:14.912292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 542/1067] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:06:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:14.913309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:14.914549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:14.918749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce1c8d-4240-4834-a1d8-6a21022a4189 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:14.954840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:14.955597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:14.955886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:14.956193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:14.956917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:14.957238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:14.958587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:14.970055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 526/1068] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:15.040531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40dc5-44e7-4353-bef2-d2ac327e6d48 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.078223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.079063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.079347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.079622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.091825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.093273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:15.112204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:15.113803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:15.114755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:15.114755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:15.114755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:15.114755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:15.119168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 543/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:15.120185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.227412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5e682-3e01-4ec6-a0b2-75bf6aaf73ab None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.265918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.266585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.266872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.267198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.268061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:15.268276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.269659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46092650-11f8-45a1-b120-391a4305a19c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.282277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 527/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:15.288655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.292464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.387432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287af0-f729-45c6-b88f-07c9f11d0e12 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.420778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.421567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.421856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.422186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.424045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ffd2b-7742-4a0f-be4d-ff1fa01c7de3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.424340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ffd2b-7742-4a0f-be4d-ff1fa01c7de3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.424627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ffd2b-7742-4a0f-be4d-ff1fa01c7de3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.425999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 528/1071] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:06:15.430256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.431304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.431594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.431719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.431879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:06:15.447418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:15.448542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:06:15.449542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:15.450093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:15.450176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 544/1072] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:15.450245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:15.454117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.462874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.516350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 529/1073] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:15.516546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.539570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.556320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1678c-ef27-40a4-bd46-c1cdcdd1fc3a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.589809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.590480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.590768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.591067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.591901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:15.592215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.593639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.615626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 545/1074] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:15.616650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.636687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768414d-92b2-4c47-b739-94b382008d93 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.670573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.671334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.671625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.671900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.682559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:15.690187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:15.691771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:15.692634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 530/1075] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:15.697769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.708358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.716184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24027f6-cee8-4e45-8d50-a797365be469 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.740552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.752282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.753102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.753390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.753668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.764745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.766199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:15.783602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:15.785063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:15.785947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:15.785947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:15.785947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:15.785947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:15.785947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 546/1076] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:15.791002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.807810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e7d01-2f43-4839-99cb-00dd0e580faa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.840320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.840972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.841257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.841535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.842271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:15.842581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.843956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.852433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 531/1077] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:15.857982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.889509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d059-c500-499b-8b90-3239362569f8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.924059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.924730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.925588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.925926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.926270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.926999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:15.927329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.928967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:15.940151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 547/1078] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:15.945686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:15.958047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f813568-9b58-4b17-bec0-5afa5f295d3a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:15.978959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:15.992468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:15.993417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:15.993707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:15.993983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] PATH_INFO: `/v3/users/eb7f88569a6845b1a20c228ad51e8f8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:15.995221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] RBAC: Authorizing `identity:get_user(user_id=eb7f88569a6845b1a20c228ad51e8f8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:15.996649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:16.003095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 532/1079] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/users/eb7f88569a6845b1a20c228ad51e8f8f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:16.003906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:16.048117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f17093-293c-4fe4-8cba-ac46674300de None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:16.081231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:16.082024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:16.082312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:16.082601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:16.089181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:16.090607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:16.100264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82640275-f67d-43f4-8e24-0f1d92dd79ae None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:06:16.105198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:16.106075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:16.106971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 548/1080] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:16.111908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:16.138005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:16.138867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:16.139180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:16.139457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:16.140632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] RBAC: Authorizing `identity:get_project(project_id=41a03b34c5fa46eda9702b269a49533a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:16.142062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:16.144311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 533/1081] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:16 2022] GET /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:16.150106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:16.158800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:16.203813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:16.213705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddedabc-73eb-4b59-b516-a9c14ca92f6d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:16.248909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:16.249575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:16.249868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:16.250149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:16.250938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:16.251281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:16.252702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:16.253268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd1497a-57fb-42c7-8518-d50ef93b9f78 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:16.265946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 549/1082] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:06:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:16.272319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:16.286732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6b050-8146-482d-9adb-d1e8844d0817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:16.287643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6b050-8146-482d-9adb-d1e8844d0817 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:16.287927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6b050-8146-482d-9adb-d1e8844d0817 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:16.288207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6b050-8146-482d-9adb-d1e8844d0817 None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a/users/eb7f88569a6845b1a20c228ad51e8f8f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:16.290144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6b050-8146-482d-9adb-d1e8844d0817 None admin] RBAC: Authorizing `identity:create_grant(project_id=41a03b34c5fa46eda9702b269a49533a, user_id=eb7f88569a6845b1a20c228ad51e8f8f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:16.291605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6b050-8146-482d-9adb-d1e8844d0817 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:16.304874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 534/1083] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:06:16 2022] PUT /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a/users/eb7f88569a6845b1a20c228ad51e8f8f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:06:16.377397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c578-b730-4de0-ae9b-fde751f0da9e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:16.413589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91775974-1504-4878-83f9-32d3483d6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:16.414527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91775974-1504-4878-83f9-32d3483d6648 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:16.414796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91775974-1504-4878-83f9-32d3483d6648 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:16.415100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91775974-1504-4878-83f9-32d3483d6648 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/14b23668139e429bacd32a5d4fc0994e/roles/a6be1b4fe8f246d08064b3f019184375` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:16.417394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91775974-1504-4878-83f9-32d3483d6648 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=14b23668139e429bacd32a5d4fc0994e, role_id=a6be1b4fe8f246d08064b3f019184375)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:16.418835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91775974-1504-4878-83f9-32d3483d6648 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:16.432893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 550/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:06:16 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/14b23668139e429bacd32a5d4fc0994e/roles/a6be1b4fe8f246d08064b3f019184375 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:06:18.304920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1c38-ec4b-4995-afd0-8018b02b857c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.305421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1c38-ec4b-4995-afd0-8018b02b857c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.305421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb1c38-ec4b-4995-afd0-8018b02b857c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.306780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 535/1085] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:18.312095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72ad4-0a84-4ead-8f6c-16c8e9ef0196 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.312491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72ad4-0a84-4ead-8f6c-16c8e9ef0196 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.312779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72ad4-0a84-4ead-8f6c-16c8e9ef0196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.329818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-91a72ad4-0a84-4ead-8f6c-16c8e9ef0196 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:18.331015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-91a72ad4-0a84-4ead-8f6c-16c8e9ef0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:18.340980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:18.399724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 551/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:18.422805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb1c38-ec4b-4995-afd0-8018b02b857c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.436205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377833ee-630c-476f-afe5-8b62611f0b30 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.436501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377833ee-630c-476f-afe5-8b62611f0b30 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.436785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377833ee-630c-476f-afe5-8b62611f0b30 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.438144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 552/1087] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:06:18.443525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.443816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.444093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.460249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:18.461417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:18.490076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:18.526502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb1c38-ec4b-4995-afd0-8018b02b857c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:18.527544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 553/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:18.551499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.560928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:18.561652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.561942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.562222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.572665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:18.580306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:18.581358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:18.582204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 536/1089] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:18.587408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.627116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:18.653683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bead-2111-465f-a3f3-08bcbf876f84 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:18.686114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672f978-0e77-415d-a4ea-1e67cc52c49b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:18.688737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:18.689628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.689915 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.690196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.701039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:18.709088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:18.710130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:18.710982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 554/1090] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:18.712757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:18.716378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.723628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:18.724478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.724801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.725151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.725936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:18.726348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:18.728204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:18.738223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 537/1091] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:18.743813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.827503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322aa7e-366c-47a9-8bcb-adb6e9480150 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:18.849319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed347e1-54c5-4e7b-af72-dc89232ff921 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:18.866548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:18.867261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.867552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.867829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.868575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:18.868883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:18.870250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:18.871827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:18.879736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 555/1092] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:18.885204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.890653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:18.891573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:18.891855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:18.892132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] PATH_INFO: `/v3/users/eb7f88569a6845b1a20c228ad51e8f8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:18.893314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] RBAC: Authorizing `identity:get_user(user_id=eb7f88569a6845b1a20c228ad51e8f8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:18.894803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:18.896565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 538/1093] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/users/eb7f88569a6845b1a20c228ad51e8f8f => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:18.901999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:18.958288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:18.984287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2dab9-c440-4c67-b3e3-1fdfbc5e16e6 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.004830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cbeba-5ad6-43eb-b652-0fcdf08888aa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.020235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.021038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.021323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.021606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.031872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.033272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.038576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.039253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.039543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.039827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:19.051205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:19.052159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:19.053332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:19.053332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:19.053332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:19.053332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:19.053332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 556/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:19.058272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.105030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.110390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.111896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.156520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d79a-74b4-4f2c-9e3d-d4ed3a729d7a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.167392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.193006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.193668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.193953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.194227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.194939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:19.195274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.196623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.209486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 557/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:19.214928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.215458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 539/1096] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 11:06:19.220852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.312232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff8ad6-ea48-4d64-bebe-bac13d7ed621 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.318671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1647aa-f8ae-4c9d-881a-107929d6c982 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.322505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.347389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.348178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.348467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.348745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.353155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.354000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.354286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.354567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.355757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.355877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] RBAC: Authorizing `identity:get_project(project_id=41a03b34c5fa46eda9702b269a49533a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.357130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.357222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.358845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 540/1097] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:19.364714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:06:19.371468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:19.372510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:19.373502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 558/1098] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:19.378017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.388806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.463642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3cee0-f8ac-4f21-81bf-06315d07aa0f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.477264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393578c-f92e-4424-a518-fb78e0e4a4c8 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.497896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.498727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.499015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.499324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.500146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=41a03b34c5fa46eda9702b269a49533a, user.id=eb7f88569a6845b1a20c228ad51e8f8f) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:19.500459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.501879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.508392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 541/1099] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/role_assignments?user.id=eb7f88569a6845b1a20c228ad51e8f8f&scope.project.id=41a03b34c5fa46eda9702b269a49533a&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:19.514338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.515028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.515353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.515638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.516497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:19.516815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.518287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.538871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 559/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:19.544753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.637644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.650428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d140ad3-e250-4372-9d11-ef2969d57477 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.685652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.686300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.686587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.686867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:19.754952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:19.756440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:19.839233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.852938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 542/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:19.858588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:19.885723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:19.958171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16b6cb-d034-48b6-a5de-5fa80ac1cbc4 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:19.991474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:19.992273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:19.992562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:19.992842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:20.004113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:20.005561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:20.023480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:20.024416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:20.025304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:06:20.025304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:20.025304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:06:20.025304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:20.025304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 560/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:20.030417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:20.130120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347736c-6406-4ecc-b8f6-90f751d15283 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:20.164269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:20.164939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:20.165227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:20.165510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:20.166237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:20.166551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:20.167967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:20.180016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 543/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:20.185996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:20.271726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:20.295568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990f566-a9c1-4041-b3f9-7c3afda79447 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:20.330535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:20.331895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:20.332183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:20.332462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:20.339718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:20.341163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:06:20.354764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:20.355666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:20.356602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 561/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:06:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:06:20.362194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:20.414719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:20.471348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13e2f3-5f28-4ac0-b191-f03acd9199d2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:20.510996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:20.512132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:20.512633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:20.513075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:20.514229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:20.514571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:20.517306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaffbd0-8f6f-42d4-9816-ec3aa3626059 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:20.530549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 544/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:20.536727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:20.636828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564c3f4-1e2c-4c8c-8bf4-d26267fe01e1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:20.669687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:20.670347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:20.670635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:20.670923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:20.671795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] RBAC: Adding query filter params (role.id=a6be1b4fe8f246d08064b3f019184375, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=14b23668139e429bacd32a5d4fc0994e) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:20.672116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:20.673546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de88b3-1a30-499f-96a7-536c3f07d7f3 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:20.680645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 562/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:20 2022] GET /identity/v3/role_assignments?user.id=14b23668139e429bacd32a5d4fc0994e&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=a6be1b4fe8f246d08064b3f019184375 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:21.631835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7359e-60fa-43ca-a9c1-5a020e721ad2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:21.632384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7359e-60fa-43ca-a9c1-5a020e721ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:21.632384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7359e-60fa-43ca-a9c1-5a020e721ad2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:21.633753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 545/1107] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:21.638748 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:21.639154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:21.639341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:21.644284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:21.656756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:21.657912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:21.722618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 563/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:21.747259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7359e-60fa-43ca-a9c1-5a020e721ad2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:21.844551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7359e-60fa-43ca-a9c1-5a020e721ad2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:21.853833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:21.878274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971751f-5755-42df-b69a-3e94eba169ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:21.879061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971751f-5755-42df-b69a-3e94eba169ae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:21.879362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971751f-5755-42df-b69a-3e94eba169ae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:21.879640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971751f-5755-42df-b69a-3e94eba169ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:21.880794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971751f-5755-42df-b69a-3e94eba169ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:21.882251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971751f-5755-42df-b69a-3e94eba169ae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:21.883836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 546/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:21.889431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:21.984668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc91458-d199-4e3f-80f1-67c3618681b6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:22.013349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:22.018751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7e45-5bd2-4c3b-8b65-fb2a09db18bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:22.019454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7e45-5bd2-4c3b-8b65-fb2a09db18bf None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:22.019739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7e45-5bd2-4c3b-8b65-fb2a09db18bf None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:22.020014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7e45-5bd2-4c3b-8b65-fb2a09db18bf None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:22.020717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b7e45-5bd2-4c3b-8b65-fb2a09db18bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:22.022128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b7e45-5bd2-4c3b-8b65-fb2a09db18bf None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:22.042263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 564/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:06:21 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:24.062682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a01150-381a-4f2d-878d-abea5bf7c996 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:24.063239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a01150-381a-4f2d-878d-abea5bf7c996 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:24.063339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a01150-381a-4f2d-878d-abea5bf7c996 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:24.064637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 547/1111] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:24.069754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:24.070145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:24.070308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:24.086476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:24.087666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:24.154631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 565/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:24.179231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a01150-381a-4f2d-878d-abea5bf7c996 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:24.278366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a01150-381a-4f2d-878d-abea5bf7c996 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:24.315150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:24.316020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:24.316302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:24.316579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] PATH_INFO: `/v3/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:24.318014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] RBAC: Authorizing `identity:get_role(role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:24.319476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:24.320962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 548/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:24 2022] GET /identity/v3/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:24.326675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:24.422083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b659d-6878-4678-bbd0-9cd77cbfeade None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:24.438807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:24.456808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:24.457673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:24.457960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:24.458238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] PATH_INFO: `/v3/users/ca935556713f44e5b20ecd40bedd7bc0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:24.470916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] RBAC: Authorizing `identity:get_user(user_id=ca935556713f44e5b20ecd40bedd7bc0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:24.472910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:24.474538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 566/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:24 2022] GET /identity/v3/users/ca935556713f44e5b20ecd40bedd7bc0 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:24.480119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:24.524201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:24.577033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d963a2-707a-4382-88a9-30112da70710 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:24.610221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:24.610855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:24.611170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:24.611452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:24.675917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:24.677347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:24.719825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:24.773936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 549/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:24.779650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:24.876146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de74027-84ab-4364-a1c8-279b5aa01083 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:24.910886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da0c53-c850-46ce-ba3a-3172b93e57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:24.912298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da0c53-c850-46ce-ba3a-3172b93e57cc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:24.912595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da0c53-c850-46ce-ba3a-3172b93e57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:24.912880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da0c53-c850-46ce-ba3a-3172b93e57cc None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:24.914311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da0c53-c850-46ce-ba3a-3172b93e57cc None admin] RBAC: Authorizing `identity:get_project(project_id=41a03b34c5fa46eda9702b269a49533a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:24.916386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da0c53-c850-46ce-ba3a-3172b93e57cc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:24.918313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 567/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:24 2022] GET /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:24.924572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:25.023497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343e85e-bde7-4e69-868b-3088d9e7faee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:25.056628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:25.057281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:25.057571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:25.057854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:25.058677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] RBAC: Adding query filter params (role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=41a03b34c5fa46eda9702b269a49533a, user.id=ca935556713f44e5b20ecd40bedd7bc0) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:25.058995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:25.060464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1187-b4bc-4382-b1cc-6d871ac838bb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:25.066387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 550/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:24 2022] GET /identity/v3/role_assignments?user.id=ca935556713f44e5b20ecd40bedd7bc0&scope.project.id=41a03b34c5fa46eda9702b269a49533a&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:27.049168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e288-5ad8-4a94-960f-a93a650eb122 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:27.049661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e288-5ad8-4a94-960f-a93a650eb122 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:27.049759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20e288-5ad8-4a94-960f-a93a650eb122 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:27.051141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 568/1118] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:27.056589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:27.056989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:27.057154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:27.073914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:27.075115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:27.077037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:27.141136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 551/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:27.165496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e288-5ad8-4a94-960f-a93a650eb122 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:27.215091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:27.270190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20e288-5ad8-4a94-960f-a93a650eb122 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:27.302888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:27.304010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:27.304292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:27.304568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] PATH_INFO: `/v3/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:27.306007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] RBAC: Authorizing `identity:get_role(role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:27.307387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:27.308736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 569/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:27 2022] GET /identity/v3/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:27.314626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:27.408800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b48a2-11c1-481d-9a9e-cd15a0b4670d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:27.441810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:27.442656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:27.442935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:27.443239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] PATH_INFO: `/v3/users/ca935556713f44e5b20ecd40bedd7bc0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:27.444397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] RBAC: Authorizing `identity:get_user(user_id=ca935556713f44e5b20ecd40bedd7bc0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:27.445812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:27.447410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 552/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:27 2022] GET /identity/v3/users/ca935556713f44e5b20ecd40bedd7bc0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:27.452958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:27.553787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90bce-506c-4b10-b784-57902f0c6a04 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:27.567165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:27.588118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c3dde-becc-4630-8d2d-c5cc1a025eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:27.588968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3dde-becc-4630-8d2d-c5cc1a025eee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:27.589254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3dde-becc-4630-8d2d-c5cc1a025eee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:27.589530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c3dde-becc-4630-8d2d-c5cc1a025eee None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:27.590695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3dde-becc-4630-8d2d-c5cc1a025eee None admin] RBAC: Authorizing `identity:get_project(project_id=41a03b34c5fa46eda9702b269a49533a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:27.592143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c3dde-becc-4630-8d2d-c5cc1a025eee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:27.593825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 570/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:27 2022] GET /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:27.600624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:27.609295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:27.699290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818cd79-8bbb-4aea-8224-16b01ad85093 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:27.731155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a2ae-203c-4886-b3bb-7345e47312f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:27.732025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a2ae-203c-4886-b3bb-7345e47312f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:27.732307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a2ae-203c-4886-b3bb-7345e47312f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:27.732577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a2ae-203c-4886-b3bb-7345e47312f6 None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a/users/ca935556713f44e5b20ecd40bedd7bc0/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:27.734729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a2ae-203c-4886-b3bb-7345e47312f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=41a03b34c5fa46eda9702b269a49533a, user_id=ca935556713f44e5b20ecd40bedd7bc0, role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:27.736165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a2ae-203c-4886-b3bb-7345e47312f6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:27.748609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 553/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:06:27 2022] PUT /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a/users/ca935556713f44e5b20ecd40bedd7bc0/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:06:29.721960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818d36d-08e4-44b3-be13-5a0470ce7257 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:29.722516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818d36d-08e4-44b3-be13-5a0470ce7257 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:29.722616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818d36d-08e4-44b3-be13-5a0470ce7257 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:29.723944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 571/1124] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:29.729363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:29.729756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:29.729916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:29.746075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:29.747275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:29.804396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:29.812133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 554/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:29.835937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818d36d-08e4-44b3-be13-5a0470ce7257 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:29.934385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818d36d-08e4-44b3-be13-5a0470ce7257 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:29.966868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:29.967734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:29.968020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:29.968297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] PATH_INFO: `/v3/roles/b383dca33b544088b66ea9b9a0ad1c9f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:29.969732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] RBAC: Authorizing `identity:get_role(role_id=b383dca33b544088b66ea9b9a0ad1c9f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:29.971102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:29.973122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 572/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:29 2022] GET /identity/v3/roles/b383dca33b544088b66ea9b9a0ad1c9f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:29.978479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:30.073405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5b0a6-a864-42cb-9538-3892ed6fa639 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:30.105637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:30.106487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:30.106771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:30.107062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] PATH_INFO: `/v3/users/ca935556713f44e5b20ecd40bedd7bc0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:30.108228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] RBAC: Authorizing `identity:get_user(user_id=ca935556713f44e5b20ecd40bedd7bc0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:30.109644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:30.111256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 555/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:29 2022] GET /identity/v3/users/ca935556713f44e5b20ecd40bedd7bc0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:30.116870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:30.165093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:30.215242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33798-0676-4db8-bda7-590077631009 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:30.247527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:30.248108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:30.248394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:30.248675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:30.317182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:30.318617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:30.370435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:30.419559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 573/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:30.425839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:30.485971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:30.522668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5f71c-7a05-4530-95ce-9c095cc9d57d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:30.555113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8003e6-6f13-4a3f-bde0-e15c46cbceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:30.555952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8003e6-6f13-4a3f-bde0-e15c46cbceff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:30.556232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8003e6-6f13-4a3f-bde0-e15c46cbceff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:30.556502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8003e6-6f13-4a3f-bde0-e15c46cbceff None admin] PATH_INFO: `/v3/projects/41a03b34c5fa46eda9702b269a49533a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:30.557656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8003e6-6f13-4a3f-bde0-e15c46cbceff None admin] RBAC: Authorizing `identity:get_project(project_id=41a03b34c5fa46eda9702b269a49533a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:30.559094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8003e6-6f13-4a3f-bde0-e15c46cbceff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:30.560743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 556/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:30 2022] GET /identity/v3/projects/41a03b34c5fa46eda9702b269a49533a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:30.567353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:30.665304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be29e86-faa7-44f5-b63c-f6777b72053e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:30.700260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:30.700919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:30.701206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:30.701476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:30.702302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] RBAC: Adding query filter params (role.id=b383dca33b544088b66ea9b9a0ad1c9f, scope.project.id=41a03b34c5fa46eda9702b269a49533a, user.id=ca935556713f44e5b20ecd40bedd7bc0) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:30.702619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:30.704065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f39c8-10a4-4d4a-a7b4-a9d1c864b0d1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:30.715072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 574/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:30 2022] GET /identity/v3/role_assignments?user.id=ca935556713f44e5b20ecd40bedd7bc0&scope.project.id=41a03b34c5fa46eda9702b269a49533a&role.id=b383dca33b544088b66ea9b9a0ad1c9f => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:32.725653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc701-90bc-45dd-bc4f-15994c08701c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:32.726186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc701-90bc-45dd-bc4f-15994c08701c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:32.726186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebc701-90bc-45dd-bc4f-15994c08701c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:32.727590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 557/1131] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:32.732557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:32.732928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:32.733123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:32.749880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:32.751067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:32.758765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:32.817230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 575/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:32.840041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebc701-90bc-45dd-bc4f-15994c08701c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:32.937994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebc701-90bc-45dd-bc4f-15994c08701c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:32.969331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:32.976448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681afb7-7f10-4b67-b733-4c53d21a067e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:32.977174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681afb7-7f10-4b67-b733-4c53d21a067e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:32.977458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681afb7-7f10-4b67-b733-4c53d21a067e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:32.977732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681afb7-7f10-4b67-b733-4c53d21a067e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:32.978889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681afb7-7f10-4b67-b733-4c53d21a067e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:32.980344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681afb7-7f10-4b67-b733-4c53d21a067e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:32.981937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 558/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:32.987786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:33.084008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4eff-d659-4d49-81e2-37e1b00dcfab None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:33.116174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269807a-736d-494d-8a7d-8e5058b16ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:33.116821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269807a-736d-494d-8a7d-8e5058b16ad2 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:33.117110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269807a-736d-494d-8a7d-8e5058b16ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:33.117391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269807a-736d-494d-8a7d-8e5058b16ad2 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:33.118091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269807a-736d-494d-8a7d-8e5058b16ad2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:33.119562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269807a-736d-494d-8a7d-8e5058b16ad2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:33.132523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:33.145175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 576/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:06:32 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:35.168908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c76b-356c-46a5-a460-e48d2b53e296 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:35.169435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c76b-356c-46a5-a460-e48d2b53e296 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:35.169558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03c76b-356c-46a5-a460-e48d2b53e296 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:35.170821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 559/1135] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:35.176586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:35.177001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:35.177154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:35.194333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:35.195538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:35.259892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 577/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:35.284496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c76b-356c-46a5-a460-e48d2b53e296 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:35.382091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03c76b-356c-46a5-a460-e48d2b53e296 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:35.414497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f8646-75e9-45e8-893a-872fbe1c32fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:35.415301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f8646-75e9-45e8-893a-872fbe1c32fe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:35.415585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f8646-75e9-45e8-893a-872fbe1c32fe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:35.415859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f8646-75e9-45e8-893a-872fbe1c32fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:35.417013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f8646-75e9-45e8-893a-872fbe1c32fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:35.418432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f8646-75e9-45e8-893a-872fbe1c32fe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:35.420047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 560/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:35.426118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:35.521085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18666c2c-5554-4ebb-9d9f-6de6f55d568c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:35.543933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:35.555556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4164d5-b556-48b8-b81c-8e459ccda631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:35.556225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4164d5-b556-48b8-b81c-8e459ccda631 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:35.556513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4164d5-b556-48b8-b81c-8e459ccda631 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:35.556795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4164d5-b556-48b8-b81c-8e459ccda631 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:35.557509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4164d5-b556-48b8-b81c-8e459ccda631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:35.558928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4164d5-b556-48b8-b81c-8e459ccda631 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:35.576992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 578/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:06:35 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:06:37.607112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13828d6f-a8d5-4109-a1ee-05f64a201ee6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:37.607641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13828d6f-a8d5-4109-a1ee-05f64a201ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:37.607765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13828d6f-a8d5-4109-a1ee-05f64a201ee6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:37.609021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 561/1139] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:37.614316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:37.614734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:37.614881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:37.631905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:37.633062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:37.699653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 579/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:37.723783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13828d6f-a8d5-4109-a1ee-05f64a201ee6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:37.788474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:37.821436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13828d6f-a8d5-4109-a1ee-05f64a201ee6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:37.853618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:37.854390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:37.854672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:37.854948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:37.865312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:37.872798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:37.873962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:37.875270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 562/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:37.880396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:37.975586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff12b0-d0e1-435e-ad1c-96ecaa28aa1d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:37.985735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:38.010857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:38.011554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:38.011843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:38.012123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:38.012866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:38.013177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:38.014539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:38.022444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 580/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:38.028083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:38.125078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c875844-5dbd-4e06-9c2b-aa3a87805e47 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:38.150219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:38.157935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:38.158843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:38.159168 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:38.159451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] PATH_INFO: `/v3/users/356b3c1a31984234b2d315a9bddda786` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:38.172170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] RBAC: Authorizing `identity:get_user(user_id=356b3c1a31984234b2d315a9bddda786)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:38.173615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:38.175808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 563/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:38 2022] GET /identity/v3/users/356b3c1a31984234b2d315a9bddda786 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:38.181728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:38.278413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b4ee4-d981-4281-9594-1e22a488c1c1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:38.311202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:38.311835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:38.312119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:38.312393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:38.351255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:38.382131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:38.383523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:38.478884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 581/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:38.484858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:38.581552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fea06-50f0-42bf-a052-d1f3a4276b77 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:38.614929 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7e9df-cec2-46f8-9be7-68455ac418b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:38.615837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7e9df-cec2-46f8-9be7-68455ac418b5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:38.616124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7e9df-cec2-46f8-9be7-68455ac418b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:38.616405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7e9df-cec2-46f8-9be7-68455ac418b5 None admin] PATH_INFO: `/v3/projects/cce96f2c07f94e0587e5a0ece046189c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:38.617567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7e9df-cec2-46f8-9be7-68455ac418b5 None admin] RBAC: Authorizing `identity:get_project(project_id=cce96f2c07f94e0587e5a0ece046189c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:38.618990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7e9df-cec2-46f8-9be7-68455ac418b5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:38.620671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 564/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:38 2022] GET /identity/v3/projects/cce96f2c07f94e0587e5a0ece046189c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:38.626511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:38.694890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:38.724388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd74c9-379d-45f9-942a-e939a52d3b68 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:38.756667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:38.757316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:38.757604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:38.757884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:38.758701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=cce96f2c07f94e0587e5a0ece046189c, user.id=356b3c1a31984234b2d315a9bddda786) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:38.759027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:38.760466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074d0d4-5889-49d4-b462-813cee868c7d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:38.765753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 582/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:38 2022] GET /identity/v3/role_assignments?user.id=356b3c1a31984234b2d315a9bddda786&scope.project.id=cce96f2c07f94e0587e5a0ece046189c&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:40.735950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea475eb-8c3a-4f79-86ad-83067b8276c0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:40.736499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea475eb-8c3a-4f79-86ad-83067b8276c0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:40.736499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea475eb-8c3a-4f79-86ad-83067b8276c0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:40.738469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 565/1147] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:40.743705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:40.744152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:40.744253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:40.760598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:40.761763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:40.826514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 583/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 11:06:40.849052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea475eb-8c3a-4f79-86ad-83067b8276c0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:40.910255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:40.954136 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea475eb-8c3a-4f79-86ad-83067b8276c0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:40.986989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:40.987736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:40.988020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:40.988297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:41.000658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:41.008247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:41.009502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:41.010438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 566/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:41.016364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:41.079755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:41.113963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ab51e-c9e9-480f-b5b8-270e2941ec5c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:41.146930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:41.147609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:41.147893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:41.148168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:41.148900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:41.149204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:41.150550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:41.158445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 584/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:41.164649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:41.261963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566362-4ffb-4d31-a221-9b9666ff4554 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:41.275496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:41.294869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:41.295747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:41.296032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:41.296307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] PATH_INFO: `/v3/users/356b3c1a31984234b2d315a9bddda786` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:41.297461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] RBAC: Authorizing `identity:get_user(user_id=356b3c1a31984234b2d315a9bddda786)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:41.298879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:41.300582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 567/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:41 2022] GET /identity/v3/users/356b3c1a31984234b2d315a9bddda786 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:41.306502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:41.404767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fa5eb-04a1-4ef6-b858-cf5359b12e07 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:41.430079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:41.437940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e659783-a869-4523-8432-8bd565b01298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:41.438794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659783-a869-4523-8432-8bd565b01298 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:41.439112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659783-a869-4523-8432-8bd565b01298 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:41.439397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e659783-a869-4523-8432-8bd565b01298 None admin] PATH_INFO: `/v3/projects/cce96f2c07f94e0587e5a0ece046189c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:41.441078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659783-a869-4523-8432-8bd565b01298 None admin] RBAC: Authorizing `identity:get_project(project_id=cce96f2c07f94e0587e5a0ece046189c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:41.442490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e659783-a869-4523-8432-8bd565b01298 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:41.444191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 585/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:41 2022] GET /identity/v3/projects/cce96f2c07f94e0587e5a0ece046189c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:41.449804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:41.545713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f5857e-a057-48a3-b7f6-f42300cd7a79 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:41.577960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5c06c-04ca-4714-895e-7ccd218ab3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:41.578827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5c06c-04ca-4714-895e-7ccd218ab3fa None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:41.579139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5c06c-04ca-4714-895e-7ccd218ab3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:41.579419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5c06c-04ca-4714-895e-7ccd218ab3fa None admin] PATH_INFO: `/v3/projects/cce96f2c07f94e0587e5a0ece046189c/users/356b3c1a31984234b2d315a9bddda786/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:41.581896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5c06c-04ca-4714-895e-7ccd218ab3fa None admin] RBAC: Authorizing `identity:create_grant(project_id=cce96f2c07f94e0587e5a0ece046189c, user_id=356b3c1a31984234b2d315a9bddda786, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:41.583334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5c06c-04ca-4714-895e-7ccd218ab3fa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:41.595874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 568/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:06:41 2022] PUT /identity/v3/projects/cce96f2c07f94e0587e5a0ece046189c/users/356b3c1a31984234b2d315a9bddda786/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:06:43.582495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47182e-faa6-4459-9f55-766e886495a8 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:43.583024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47182e-faa6-4459-9f55-766e886495a8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:43.583224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47182e-faa6-4459-9f55-766e886495a8 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:43.584558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 586/1154] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:43.589570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:43.590000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:43.590130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:43.606873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:43.608055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:43.641725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:43.673334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 569/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:43.699558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47182e-faa6-4459-9f55-766e886495a8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:43.810802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47182e-faa6-4459-9f55-766e886495a8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:43.843253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:43.843985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:43.844278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:43.844562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:43.855111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:43.863370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:43.864379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:43.865248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 587/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:43.870725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:43.965094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddffc1-ad31-48d3-888f-f7befd6cd4ef None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:43.997625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:43.998284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:43.998572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:43.998845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:43.999611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:44.000250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:44.001255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:44.009261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 570/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:44.015027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:44.070725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:44.115061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec780de-6062-4cab-8aa7-b4a62e673a94 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:44.147761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:44.148616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:44.148903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:44.149185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] PATH_INFO: `/v3/users/356b3c1a31984234b2d315a9bddda786` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:44.150359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] RBAC: Authorizing `identity:get_user(user_id=356b3c1a31984234b2d315a9bddda786)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:44.151812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:44.153405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 588/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:44 2022] GET /identity/v3/users/356b3c1a31984234b2d315a9bddda786 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:44.158939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:44.193038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:44.256001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8f67-c31d-4282-a678-9e95e5cf9e1b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:44.287812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:44.288435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:44.288717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:44.288991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:44.352791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:44.354209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:44.385364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:44.454518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 571/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:44.460329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:44.564759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ea9c6-7914-4d99-a347-151feab58464 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:44.587729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:44.598908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4f26c-4937-4676-9e96-b6a02bdfa076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:44.599809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f26c-4937-4676-9e96-b6a02bdfa076 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:44.600105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f26c-4937-4676-9e96-b6a02bdfa076 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:44.600387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4f26c-4937-4676-9e96-b6a02bdfa076 None admin] PATH_INFO: `/v3/projects/cce96f2c07f94e0587e5a0ece046189c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:44.601565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f26c-4937-4676-9e96-b6a02bdfa076 None admin] RBAC: Authorizing `identity:get_project(project_id=cce96f2c07f94e0587e5a0ece046189c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:44.602986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4f26c-4937-4676-9e96-b6a02bdfa076 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:44.604713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 589/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:44 2022] GET /identity/v3/projects/cce96f2c07f94e0587e5a0ece046189c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:06:44.610853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:44.707123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0881f87-d463-4c68-9bc2-c624e2b8ce4e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:44.739584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:44.740221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:44.740502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:44.740777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:44.741585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=cce96f2c07f94e0587e5a0ece046189c, user.id=356b3c1a31984234b2d315a9bddda786) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:44.741897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:44.743327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7786-c387-45d8-b547-c36fb604d5c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:44.745062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:44.749959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 572/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:44 2022] GET /identity/v3/role_assignments?user.id=356b3c1a31984234b2d315a9bddda786&scope.project.id=cce96f2c07f94e0587e5a0ece046189c&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:46.761497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26c87-f976-49cf-857d-68b1d3e6f994 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:46.762063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26c87-f976-49cf-857d-68b1d3e6f994 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:46.762063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a26c87-f976-49cf-857d-68b1d3e6f994 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:46.763464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 590/1162] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:46.769038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:46.769459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:46.769590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:46.785769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:46.786920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:46.850677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 573/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:46.873045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a26c87-f976-49cf-857d-68b1d3e6f994 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:46.971999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a26c87-f976-49cf-857d-68b1d3e6f994 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:47.006410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:47.007084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:47.007375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:47.007654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:47.068390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:47.078312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:47.079813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:47.173637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 591/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:47.180282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:47.276563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19d7aa-9c6d-4ce0-8c8d-149e6ffe061c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:47.302590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:47.310890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:47.311712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:47.312001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:47.312279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:47.318827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:47.320253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b9e2a50b-fada-46b8-b0ba-95de3f22c3f7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:47.334210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:47.335456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:06:47.336534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 574/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:06:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:47.341439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:47.430290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:47.439230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428988c9-c6c2-4ee5-94af-b98089b2617e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:47.472276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:47.472930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:47.473217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:47.473496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:47.474211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:47.474519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:47.475898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec208066-8524-44c1-a87d-e4b6dc67f63e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:47.482847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 592/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jun 29 11:06:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:49.461912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad433d1-a409-4baf-8c50-b46bb73522ee None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:49.462497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad433d1-a409-4baf-8c50-b46bb73522ee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:49.462497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad433d1-a409-4baf-8c50-b46bb73522ee None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:49.463873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 575/1167] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:49.469010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be188-6d1a-41dc-9320-f1e59b670cb4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:49.469442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be188-6d1a-41dc-9320-f1e59b670cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:49.469605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273be188-6d1a-41dc-9320-f1e59b670cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:49.486313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-273be188-6d1a-41dc-9320-f1e59b670cb4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:49.487516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-273be188-6d1a-41dc-9320-f1e59b670cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:49.558765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 593/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:49.582216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad433d1-a409-4baf-8c50-b46bb73522ee None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:49.680770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad433d1-a409-4baf-8c50-b46bb73522ee None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:49.714091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e910ff-e162-4baa-97c9-729a3afa8388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:49.714676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e910ff-e162-4baa-97c9-729a3afa8388 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:49.714959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e910ff-e162-4baa-97c9-729a3afa8388 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:49.715263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e910ff-e162-4baa-97c9-729a3afa8388 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:49.715988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e910ff-e162-4baa-97c9-729a3afa8388 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:49.717346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e910ff-e162-4baa-97c9-729a3afa8388 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:49.731082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 576/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Wed Jun 29 11:06:49 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:51.777568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1d90-3b46-47ab-961f-fe6b92e16b7c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:51.778123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1d90-3b46-47ab-961f-fe6b92e16b7c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:51.778123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1d90-3b46-47ab-961f-fe6b92e16b7c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:51.779530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 594/1170] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:51.784574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:51.784982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:51.785147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:51.801440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:51.802619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:51.845725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:51.869189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 577/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:51.892660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1d90-3b46-47ab-961f-fe6b92e16b7c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:51.976004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:51.991823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1d90-3b46-47ab-961f-fe6b92e16b7c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:52.025504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17299ce0-d1e4-4e95-bd1a-58a849e5e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:52.026359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299ce0-d1e4-4e95-bd1a-58a849e5e57a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:52.026643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299ce0-d1e4-4e95-bd1a-58a849e5e57a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:52.026921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17299ce0-d1e4-4e95-bd1a-58a849e5e57a None admin] PATH_INFO: `/v3/domains/4a7b999605364170b69eb9e708c5089b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:52.037025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17299ce0-d1e4-4e95-bd1a-58a849e5e57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=4a7b999605364170b69eb9e708c5089b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:52.038388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17299ce0-d1e4-4e95-bd1a-58a849e5e57a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:52.040026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 595/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Jun 29 11:06:51 2022] GET /identity/v3/domains/4a7b999605364170b69eb9e708c5089b => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:52.045789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:52.142699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc2f28-64e5-4040-a708-c4139cef4b61 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:52.175362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73db2be-c0b2-46a2-907b-7c1ec6879d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:52.176008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db2be-c0b2-46a2-907b-7c1ec6879d57 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:52.176294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db2be-c0b2-46a2-907b-7c1ec6879d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:52.176570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73db2be-c0b2-46a2-907b-7c1ec6879d57 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:52.177268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db2be-c0b2-46a2-907b-7c1ec6879d57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:52.178946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73db2be-c0b2-46a2-907b-7c1ec6879d57 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:52.203307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 578/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:06:52 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:54.240353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e6d7-087d-4bc9-82d5-161bda6f79fc None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:54.240899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e6d7-087d-4bc9-82d5-161bda6f79fc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:54.240899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237e6d7-087d-4bc9-82d5-161bda6f79fc None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:54.242268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 596/1174] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:54.247306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:54.247705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:54.247876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:54.264395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:54.265523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:54.289063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:54.339918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 579/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:54.365357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e6d7-087d-4bc9-82d5-161bda6f79fc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:54.463502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237e6d7-087d-4bc9-82d5-161bda6f79fc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:54.502247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563a66e-5b29-466b-b51f-09171b051843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:54.503128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a66e-5b29-466b-b51f-09171b051843 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:54.503412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a66e-5b29-466b-b51f-09171b051843 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:54.503686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563a66e-5b29-466b-b51f-09171b051843 None admin] PATH_INFO: `/v3/domains/4a7b999605364170b69eb9e708c5089b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:54.504836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a66e-5b29-466b-b51f-09171b051843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4a7b999605364170b69eb9e708c5089b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:54.506250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563a66e-5b29-466b-b51f-09171b051843 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:54.507867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 597/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Jun 29 11:06:54 2022] GET /identity/v3/domains/4a7b999605364170b69eb9e708c5089b => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:54.513462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:54.608780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e4afd-cbf6-469e-a472-cf1bcd5ec36f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:54.640488 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60d6d-1e68-4441-b67f-6da8784f517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:54.641134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60d6d-1e68-4441-b67f-6da8784f517c None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:54.641417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60d6d-1e68-4441-b67f-6da8784f517c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:54.641691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60d6d-1e68-4441-b67f-6da8784f517c None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:54.642378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf60d6d-1e68-4441-b67f-6da8784f517c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:54.644362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf60d6d-1e68-4441-b67f-6da8784f517c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:54.665205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 580/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:06:54 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:06:56.722816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d143a-9c0c-44ef-afae-eb4f466f2b92 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:56.723564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d143a-9c0c-44ef-afae-eb4f466f2b92 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:56.723564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d143a-9c0c-44ef-afae-eb4f466f2b92 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:56.724800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 598/1178] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:56.729958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:56.730375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:56.730527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:56.746779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:56.747981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:56.758840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:56.814339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 581/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:56.838685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d143a-9c0c-44ef-afae-eb4f466f2b92 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:56.854433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:56.937981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d143a-9c0c-44ef-afae-eb4f466f2b92 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:56.970557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:56.971980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:56.972264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:56.972540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:56.982359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:06:56.989896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:06:56.990937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:06:56.992302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 599/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:06:56.996941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:57.093839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a4c17-76fa-4626-9a90-c44e3091a4f7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:57.126369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:57.127579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:57.127877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:57.128160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:57.128899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:57.129209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:57.130573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:57.138406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 582/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:57.144748 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:57.218484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:57.242925 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149ccd0-1a6a-4fd0-b218-03f978fb5fd1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:57.276253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:57.277115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:57.277402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:57.277678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] PATH_INFO: `/v3/users/8a4c75042a344fa59a60ed850cd2d198` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:57.290506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=8a4c75042a344fa59a60ed850cd2d198)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:57.291963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:57.293580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 600/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:06:57 2022] GET /identity/v3/users/8a4c75042a344fa59a60ed850cd2d198 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:57.299242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:57.311230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:57.398462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fecd4-d016-461f-8bd7-b077424df81e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:57.431195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:57.431826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:57.432112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:57.432390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:57.504377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:57.505749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:57.514852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:57.600075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 583/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:06:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:06:57.605899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:57.703745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629c836-f969-4bb1-8eb6-316e57b47fe5 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:57.732262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:57.738038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da7a02-219c-4a26-808b-6bfc06e25a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:57.738891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7a02-219c-4a26-808b-6bfc06e25a8a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:57.739210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7a02-219c-4a26-808b-6bfc06e25a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:57.739489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da7a02-219c-4a26-808b-6bfc06e25a8a None admin] PATH_INFO: `/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:57.740663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da7a02-219c-4a26-808b-6bfc06e25a8a None admin] RBAC: Authorizing `identity:get_project(project_id=4f00dfd706d245cd9c545a8b6bc66c3f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:57.742081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da7a02-219c-4a26-808b-6bfc06e25a8a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:57.743791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 601/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:06:57 2022] GET /identity/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:57.749856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:06:57.844403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75c369-ffd0-4bb8-b59f-fe9f17895fc3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:06:57.857707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:06:57.881347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:06:57.881993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:57.882275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:57.882549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:57.883396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=4f00dfd706d245cd9c545a8b6bc66c3f, user.id=8a4c75042a344fa59a60ed850cd2d198) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:06:57.883708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:06:57.885122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145353f-b756-4053-b626-ce92338e5f25 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:06:57.890390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 584/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:06:57 2022] GET /identity/v3/role_assignments?user.id=8a4c75042a344fa59a60ed850cd2d198&scope.project.id=4f00dfd706d245cd9c545a8b6bc66c3f&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:06:59.872878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c916d8-3954-452f-b3a9-354a1c712a69 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:59.873427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c916d8-3954-452f-b3a9-354a1c712a69 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:59.873427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c916d8-3954-452f-b3a9-354a1c712a69 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:59.874799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 602/1186] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:06:59.880600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:06:59.881015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:06:59.881166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:06:59.897500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:06:59.898666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:06:59.965753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 585/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:06:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:06:59.989202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c916d8-3954-452f-b3a9-354a1c712a69 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:00.087687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c916d8-3954-452f-b3a9-354a1c712a69 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:00.120894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:00.121672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:00.121957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:00.122234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:00.132178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:07:00.139723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:07:00.140838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:07:00.141995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:07:00.143212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 603/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:07:00.146873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:00.246237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f824fd-0938-4b12-8e11-4aaaa97b2579 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:00.247785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:00.281262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:00.281921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:00.282208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:00.282483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:00.283787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:07:00.284099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:00.285460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:00.293285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 586/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:00.299716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:00.357304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:00.397697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8430eb-f4cb-424f-aca2-7b821b69231f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:00.430231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:00.431116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:00.431407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:00.431689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] PATH_INFO: `/v3/users/8a4c75042a344fa59a60ed850cd2d198` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:00.432852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] RBAC: Authorizing `identity:get_user(user_id=8a4c75042a344fa59a60ed850cd2d198)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:00.434277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:00.435914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 604/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:07:00 2022] GET /identity/v3/users/8a4c75042a344fa59a60ed850cd2d198 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:00.441608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:00.541933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4c750-3531-47a1-8993-0757490f2fb7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:00.574513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058217b-0a17-4731-a970-aae3ef8883d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:00.575386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058217b-0a17-4731-a970-aae3ef8883d7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:00.575676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058217b-0a17-4731-a970-aae3ef8883d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:00.575956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058217b-0a17-4731-a970-aae3ef8883d7 None admin] PATH_INFO: `/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:00.577117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058217b-0a17-4731-a970-aae3ef8883d7 None admin] RBAC: Authorizing `identity:get_project(project_id=4f00dfd706d245cd9c545a8b6bc66c3f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:00.578538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058217b-0a17-4731-a970-aae3ef8883d7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:00.580825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 587/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:07:00 2022] GET /identity/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:00.586986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:00.686538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4c68-cfe2-46a1-9f7e-29aa67025a48 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:00.711809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:00.719628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e513d9a-fda3-4991-93db-51c979a47c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:00.720518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513d9a-fda3-4991-93db-51c979a47c3d None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:00.721421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513d9a-fda3-4991-93db-51c979a47c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:00.721702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e513d9a-fda3-4991-93db-51c979a47c3d None admin] PATH_INFO: `/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f/users/8a4c75042a344fa59a60ed850cd2d198/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:00.723709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e513d9a-fda3-4991-93db-51c979a47c3d None admin] RBAC: Authorizing `identity:create_grant(project_id=4f00dfd706d245cd9c545a8b6bc66c3f, user_id=8a4c75042a344fa59a60ed850cd2d198, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:00.725149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e513d9a-fda3-4991-93db-51c979a47c3d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:00.737014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 605/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:07:00 2022] PUT /identity/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f/users/8a4c75042a344fa59a60ed850cd2d198/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:07:02.715548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c4401-936e-4270-8ceb-8d1354631afc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:02.716106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c4401-936e-4270-8ceb-8d1354631afc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:02.716106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c4401-936e-4270-8ceb-8d1354631afc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:02.717467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 588/1193] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:07:02.723244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:02.723657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:02.723815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:02.740277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:07:02.741453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:07:02.806293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 606/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:07:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:07:02.829677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c4401-936e-4270-8ceb-8d1354631afc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:02.861427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:02.930888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c4401-936e-4270-8ceb-8d1354631afc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:02.963474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:02.964253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:02.964538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:02.964816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:02.975281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:07:02.982737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:07:02.983864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:07:02.985090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 589/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:07:02.990023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:03.087924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d79f7f-6295-45bb-b997-d5e07a285361 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:03.104764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:03.122269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:03.122939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:03.123278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:03.123559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:03.124305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:07:03.124625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:03.125981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:03.134471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 607/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:03.140448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:03.229016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:03.238020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b9388-aac9-4002-813c-0393614ffdb7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:03.270506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:03.271371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:03.271654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:03.271927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] PATH_INFO: `/v3/users/8a4c75042a344fa59a60ed850cd2d198` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:03.273079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] RBAC: Authorizing `identity:get_user(user_id=8a4c75042a344fa59a60ed850cd2d198)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:03.274495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:03.276098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 590/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jun 29 11:07:03 2022] GET /identity/v3/users/8a4c75042a344fa59a60ed850cd2d198 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:03.281841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:03.379054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cbf65-a91c-4e12-9315-5a70e3bef1e2 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:03.410692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:03.411360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:03.411651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:03.411932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:03.458526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:03.477473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:03.478899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:03.573824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 608/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:07:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:07:03.579642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:03.675419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71948b-da1a-43d4-a317-964ee5379af6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:03.708004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220071ea-39c6-4076-885d-c2c953c69c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:03.708841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220071ea-39c6-4076-885d-c2c953c69c98 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:03.709121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220071ea-39c6-4076-885d-c2c953c69c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:03.709394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220071ea-39c6-4076-885d-c2c953c69c98 None admin] PATH_INFO: `/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:03.710546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220071ea-39c6-4076-885d-c2c953c69c98 None admin] RBAC: Authorizing `identity:get_project(project_id=4f00dfd706d245cd9c545a8b6bc66c3f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:03.712062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220071ea-39c6-4076-885d-c2c953c69c98 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:03.713711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 591/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jun 29 11:07:03 2022] GET /identity/v3/projects/4f00dfd706d245cd9c545a8b6bc66c3f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:03.720083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:03.798350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:03.818155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fd615-1e5a-4e47-b260-14d30a9685d1 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:03.851879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:03.852464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:03.852751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:03.853031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:03.853849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=4f00dfd706d245cd9c545a8b6bc66c3f, user.id=8a4c75042a344fa59a60ed850cd2d198) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:07:03.854163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:03.855609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45509148-be2a-4537-b79d-a169ff7b058a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:03.861884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 609/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:07:03 2022] GET /identity/v3/role_assignments?user.id=8a4c75042a344fa59a60ed850cd2d198&scope.project.id=4f00dfd706d245cd9c545a8b6bc66c3f&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:07:13.703992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:13.858706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=28 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:58.500767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f686-710c-43f2-b7d4-9b3b58ad4689 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:58.501396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f686-710c-43f2-b7d4-9b3b58ad4689 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:58.501396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180f686-710c-43f2-b7d4-9b3b58ad4689 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:58.502862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 592/1201] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:07:58.508486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:58.509011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:58.509101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:58.529012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:07:58.530437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:07:58.624342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 610/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:07:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:07:58.654166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180f686-710c-43f2-b7d4-9b3b58ad4689 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:58.799711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180f686-710c-43f2-b7d4-9b3b58ad4689 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:58.846731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:58.847579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:58.847918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:58.848200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:58.865796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:58.867536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:07:58.891099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:07:58.892902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:07:58.894748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:07:58.894748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:07:58.894748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:07:58.894748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:07:58.894748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 593/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:07:58.904542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:59.035152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb939691-f1a5-4b86-b6ad-55725636eb27 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:59.075645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:59.083175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:59.083867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:59.084214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:59.084470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:59.085234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:07:59.085628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:59.087029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e60a6-391c-406d-8497-66630be7557d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:59.102018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 611/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:07:59.108090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:07:59.174430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:07:59.237469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4063a42-7723-4469-a9d7-bc37734de746 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:07:59.276499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c80ca-37b1-4f90-9b18-3c84eb4fc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:07:59.277299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c80ca-37b1-4f90-9b18-3c84eb4fc33a None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:07:59.277598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c80ca-37b1-4f90-9b18-3c84eb4fc33a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:07:59.277903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c80ca-37b1-4f90-9b18-3c84eb4fc33a None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:07:59.278620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c80ca-37b1-4f90-9b18-3c84eb4fc33a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:07:59.280291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c80ca-37b1-4f90-9b18-3c84eb4fc33a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:07:59.306523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 594/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jun 29 11:07:59 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:08:01.478831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f42fb-e8b1-44de-9b45-245e2d34f42f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:01.479418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f42fb-e8b1-44de-9b45-245e2d34f42f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:01.479418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f42fb-e8b1-44de-9b45-245e2d34f42f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:01.480799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 612/1206] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:01.486533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:01.487078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:01.487190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:01.506784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:01.508236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:01.584756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 595/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:01.608267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f42fb-e8b1-44de-9b45-245e2d34f42f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:01.731252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f42fb-e8b1-44de-9b45-245e2d34f42f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:01.772855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:01.773709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:01.774003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:01.774254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:01.785358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:08:01.794741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:01.796000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:01.796868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 613/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:01.802251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:01.849636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:01.924441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d01545-927b-4a28-801c-db6066e72175 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:01.964481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:01.965171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:01.965464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:01.965745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:01.966504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:01.966817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:01.968249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:01.979070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 596/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:01.983236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:02.040258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:02.097814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf06f62-e4f7-4b4d-ad2e-6cdd3248269a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:02.135008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:02.135845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:02.136163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:02.136424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:02.149687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:02.151203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:02.171399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:02.172614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:02.174679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:02.174679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:02.174679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:02.174679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:02.174679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 614/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:02.179309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:02.289306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:02.292408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409146b-43ba-4a3f-95b5-b493f2089f77 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:02.330512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:02.331221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:02.331525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:02.331805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:02.332530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:02.332839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:02.334204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:02.353005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 597/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:02.354304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:02.474170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d335d-4bbd-4d0f-8d47-99e80f685d13 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:02.475964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:02.522575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:02.523433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:02.523728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:02.524014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:02.535066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:02.536527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:08:02.552030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:02.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:02.554705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:02.555375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 615/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:02.561328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:02.689540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e08ea5-9bc5-4da7-8218-c21a1c94a64f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:02.742165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:02.743116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:02.743483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:02.743825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:02.744831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:02.745254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:02.747000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:02.769133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 598/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jun 29 11:08:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:02.775527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:02.891047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cca91-56e7-4b30-942a-f1ff01a9ae84 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:02.929774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:02.930637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:02.931004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:02.931288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:02.977397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:03.029846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:03.031890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:03.169586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 616/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:08:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:08:03.175452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:03.198945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:03.301190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88b82f-eb0e-452b-80c5-d0f24cba3774 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:03.343768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:03.344623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:03.344945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:03.345323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:03.357346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:03.358937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:03.385292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:03.386300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:03.387276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:03.387276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:03.387276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:03.387276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:03.387276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 599/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:08:03.392856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:03.470010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:03.518836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941a507-8ca8-468e-b3bf-2daf759ae839 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:03.555640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:03.556315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:03.556606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:03.556887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:03.557638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:03.557996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:03.559437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:03.572318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 617/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:03.578534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:03.657707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:03.697018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eca39-4ccc-4c52-8a03-3753cbcca85c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:03.741587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:03.742407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:03.742687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:03.743005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:03.753648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:03.757234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:08:03.773430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:03.774663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:03.776022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 600/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:08:03.784214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:03.900367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9f6fb-430a-43c8-9a79-8961e8986376 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:03.930800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:03.946016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:03.946678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:03.946967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:03.947283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:03.948189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:03.948517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:03.950119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812340a8-ad03-4924-a8a4-360f84f3b777 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:03.964456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 618/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:03.970499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:04.099284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e590a5-c87c-4be9-9866-9c0f7f84b30b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:04.130875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:04.137313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:04.138182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:04.138647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:04.139157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:04.139990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=8463ca23f8c447dfad7ae62e7ba084e5) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:04.140305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:04.141731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8418-5742-4032-8c61-cbb8ebc4f8d4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:04.147588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 601/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:08:03 2022] GET /identity/v3/role_assignments?user.id=8463ca23f8c447dfad7ae62e7ba084e5&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:06.204664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c8fe-227b-4041-9d10-64da2168c15e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:06.205188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c8fe-227b-4041-9d10-64da2168c15e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:06.205308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c8fe-227b-4041-9d10-64da2168c15e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:06.206578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 619/1220] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:06.212060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:06.212474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:06.212615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:06.230258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:06.231539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:06.307161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 602/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:06.328552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7c8fe-227b-4041-9d10-64da2168c15e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:06.441669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7c8fe-227b-4041-9d10-64da2168c15e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:06.480690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:06.481812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:06.482097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:06.482380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:06.493254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:08:06.501067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:06.502233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:06.503171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 620/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:06.508721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:06.613062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84bcd9-261d-4674-a268-e0d984d376fc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:06.637353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:06.648705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:06.649369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:06.649653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:06.649932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:06.650779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:06.651163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:06.652723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:06.661964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 603/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:06.668316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:06.713921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:06.789057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb578fa-6646-4adb-9b68-a33e86508328 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:06.822879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:06.823701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:06.823986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:06.824263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:06.839359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:06.841007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:06.860508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:06.861449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:06.862367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:06.862367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:06.862367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:06.862367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:06.862367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 621/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:06.868006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:06.978727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a847d-769f-4240-bbf4-333355a8ddd8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:07.018009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:07.018676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:07.018965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:07.019283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:07.020006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:07.020321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:07.021835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:07.034840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 604/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:07.040741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:07.148110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:07.155706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a8605-e5d8-4ead-aa42-b255e980cb73 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:07.196127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:07.196936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:07.197223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:07.197503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:07.205297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:07.206727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:08:07.220975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:07.222126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:07.223296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 622/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:07.228281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:07.277156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:07.333509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cbc63-8ff7-4ad8-ae65-d03c78741cb8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:07.370226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:07.371021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:07.371340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:07.371625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:07.372705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:07.373118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:07.375284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:07.401818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 605/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jun 29 11:08:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:07.402917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:07.505125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b6a2b-9319-4585-bc94-cf6717ecde78 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:07.540893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:07.541689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:07.541978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:07.542259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:07.554792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:07.556287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:07.577084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:07.578145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:07.583931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:07.583931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:07.583931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:07.583931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:07.583931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 623/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:08:07.584828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:07.692408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cff81b-e233-4e1a-a7c9-e29d3ac3fbac None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:07.694805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:07.729512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:07.730192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:07.730477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:07.730760 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:07.731538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:07.731841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:07.733226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:07.748473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 606/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:07.754921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:07.767481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:07.882386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b27845-ad73-408c-a8f2-57f4cbcd76ee None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:07.919896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:07.920775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:07.921078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:07.921399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:07.929973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:07.931582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:08:07.948506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:07.949755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:07.950877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:07.955033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 624/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:07.956055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:08.065677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e2c05-d395-4ffa-aa55-5334226e5bdf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:08.104703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:08.105361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:08.105648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:08.105955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:08.106708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:08.107018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:08.108481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368827fb-fe8a-49a1-875b-922cae8ef090 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:08.121304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 607/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:08.128738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:08.209313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:08.248878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fb1a-9d77-4729-ad28-19011cf422b9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:08.287000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dc824-36f2-45c4-bfcf-22651e047d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:08.287919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dc824-36f2-45c4-bfcf-22651e047d33 None admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:08.288207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dc824-36f2-45c4-bfcf-22651e047d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:08.288535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dc824-36f2-45c4-bfcf-22651e047d33 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/8463ca23f8c447dfad7ae62e7ba084e5/roles/2c95580413134c98bf931ad082fefbc3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:08.306008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dc824-36f2-45c4-bfcf-22651e047d33 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=8463ca23f8c447dfad7ae62e7ba084e5, role_id=2c95580413134c98bf931ad082fefbc3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:08.307686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dc824-36f2-45c4-bfcf-22651e047d33 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:08.321165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 625/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:08:08 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/8463ca23f8c447dfad7ae62e7ba084e5/roles/2c95580413134c98bf931ad082fefbc3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:08:10.410771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623b230-2fd1-447d-b59c-4b6b606f1734 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:10.411357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623b230-2fd1-447d-b59c-4b6b606f1734 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:10.411357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623b230-2fd1-447d-b59c-4b6b606f1734 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:10.412735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 608/1233] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:10.418074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:10.418490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:10.418642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:10.436652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:10.437934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:10.510938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 626/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:10.536034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623b230-2fd1-447d-b59c-4b6b606f1734 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:10.565018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:10.647715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623b230-2fd1-447d-b59c-4b6b606f1734 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:10.681819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:10.682547 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:10.682835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:10.683151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:10.694027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:08:10.702014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:10.703708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:10.705181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 609/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jun 29 11:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:10.710239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:10.764435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:10.824700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bad6-e8dd-4abf-8834-93659f117013 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:10.859093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:10.859763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:10.860049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:10.860329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:10.861603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] RBAC: Adding query filter params (name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:10.861917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:10.863309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:10.871974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 627/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jun 29 11:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:10.878394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:10.975115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:10.994052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4111058-5133-4db2-948e-92af07ab80eb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:11.030350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:11.031150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:11.031435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:11.031752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:11.047668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:11.050815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:11.071567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:11.072519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:11.073426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:11.073426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:11.073426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:11.073426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:11.073426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 610/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:11.079281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:11.186789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c1a48-9aa3-4145-a144-e6818a5af248 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:11.196676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:11.224473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:11.225341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:11.225639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:11.225927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:11.226660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:11.226968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:11.228368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:11.242258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 628/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:11.248567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:11.357012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31878a-4712-480d-aff8-0a11858873f2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:11.396507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:11.397776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:11.398264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:11.398775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:11.401782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:11.410173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:11.411995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:08:11.428808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:11.430040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:11.431451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:11.433532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 611/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:11.439605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:11.547839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c793ef6-810d-438a-9c6a-f3a6417e484f None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:11.587376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:11.588065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:11.588354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:11.588637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:11.589499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:11.589800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:11.591261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:11.609849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 629/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jun 29 11:08:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:11.616447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:11.725518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8543cf-fc78-42d3-a4ed-b49d9b7e90c6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:11.765466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:11.766300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:11.766695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:11.767588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:11.836985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:11.844177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:11.846781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:11.966318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 612/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:08:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:08:11.972847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:12.001737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:12.084226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d8aec-24fc-463c-842a-e7544117e85a None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:12.119791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:12.120594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:12.120924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:12.121230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:12.132214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:12.133650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:12.151210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:12.152285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:12.153348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:12.153348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:12.153348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:12.153348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:12.153348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 630/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:12.158253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:12.264898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:12.272506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da65eb-e8a4-41e2-99c7-5e5f963e2566 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:12.308969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:12.309677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:12.310008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:12.310284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:12.311056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:12.311421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:12.312889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:12.325549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 613/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:12.332575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:12.420395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:12.445352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db0fbd-74e9-4b16-b9c6-4c7891f8283c None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:12.482299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:12.483103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:12.483394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:12.483676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:12.491300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:12.492736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:08:12.507285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:12.508416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:12.514354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 631/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:08:12.514983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:12.631724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233056e-5a6d-4cdd-9ab4-6d58d816c30c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:12.670550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:12.671286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:12.671578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:12.671857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:12.672647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:12.672959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:12.674532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae70ee-f326-4a14-8b34-b71cc642cb87 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:12.687712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 614/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:12.693976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:12.819537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08122d-eda4-4059-84ff-b2831717f355 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:12.856010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:12.856733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:12.857079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:12.857383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:12.858333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] RBAC: Adding query filter params (role.id=2c95580413134c98bf931ad082fefbc3, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=8463ca23f8c447dfad7ae62e7ba084e5) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:12.858685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:12.860320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8bbd-d4ba-447e-b320-eb99396fa083 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:12.867324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 632/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:08:12 2022] GET /identity/v3/role_assignments?user.id=8463ca23f8c447dfad7ae62e7ba084e5&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=2c95580413134c98bf931ad082fefbc3 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:15.132993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6e57a-b311-4b42-bc61-d74beffd862c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:15.133533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6e57a-b311-4b42-bc61-d74beffd862c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:15.133533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6e57a-b311-4b42-bc61-d74beffd862c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:15.135376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 615/1247] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:15.141899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:15.142456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:15.142556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:15.149091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:15.163167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:15.164366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:15.238467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 633/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:15.264631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6e57a-b311-4b42-bc61-d74beffd862c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:15.287391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:15.386852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6e57a-b311-4b42-bc61-d74beffd862c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:15.428003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:15.429190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:15.429443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:15.429756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:15.441140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:08:15.449869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:15.451130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:15.452014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 616/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:15.457617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:15.568918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f7a1-3fa9-4b2f-9333-141b26dea881 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:15.609483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:15.616669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:15.617410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:15.617692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:15.617972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:15.618754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:15.619292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:15.620947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:15.630098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 634/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:15.636074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:15.726779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:15.758643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81ae06-6a78-487a-a7a8-d5d09d8ac16c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:15.801176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:15.801978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:15.802349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:15.802548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:15.814686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:15.816164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:15.835994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:15.837001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:15.837934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:15.837934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:15.837934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:15.837934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:15.837934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 617/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:15.843369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:15.952628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49bd2e-bb03-4081-9242-da85c95dc743 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:15.992160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:15.992880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:15.993163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:15.993442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:15.994234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:15.994584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:15.996060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:16.011065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 635/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:16.017963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:16.137093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788ac7a-4a2d-492d-ab87-47d3d1ee6e53 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:16.166051 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:16.176277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:16.177081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:16.177395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:16.177671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:16.186422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:16.188216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:08:16.204758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:16.205926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:16.211667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 618/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:16.213491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:16.276639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:16.332643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a577b2-5696-4f0d-9bd0-0129a797b626 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:16.369237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:16.369882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:16.370194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:16.370454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:16.371328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:16.371644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:16.373065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:16.393459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 636/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jun 29 11:08:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:16.399278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:16.516191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7624fdc-9eca-44f6-9f64-baa660787f9a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:16.554834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:16.555508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:16.555791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:16.556109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:16.630463 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:16.647498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:16.648890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:16.761782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 619/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:08:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:08:16.768285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:16.883130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab21df-77cb-43e9-bceb-dfdda019c862 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:16.899072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:16.921481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:16.922372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:16.922803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:16.923144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:16.933736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:16.935200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:16.953502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:16.955206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:16.956138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:16.956138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:16.956138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:16.956138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:16.956138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 637/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 11:08:16.962179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:17.064818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:17.078426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c53553-f746-4827-8c62-ded168a7ad8c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:17.118099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:17.119243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:17.119582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:17.119868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:17.120666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:17.120990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:17.122371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:17.140380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 620/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:17.142977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:17.250075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089df5a4-640e-4ff0-8d75-00225b840c54 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:17.288938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:17.290274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:17.290861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:17.291278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:17.300231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:17.302592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:08:17.318536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:17.319679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:17.320898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 638/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:17.325754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:17.443227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33929c6-d36b-484d-982f-1e2d3a96d857 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:17.480988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:17.481652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:17.481939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:17.482261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:17.483013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:17.483358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:17.484994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b1044-3f0e-4466-b8a4-701684a209d5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:17.499786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 621/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:17.508267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:17.539505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:17.627803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042a39-be4b-4686-bb14-84206a572274 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:17.664528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:17.665213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:17.665493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:17.665766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:17.666617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=8463ca23f8c447dfad7ae62e7ba084e5) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:17.666963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:17.668567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9449f-e9ee-4664-9b09-e3ddbbdb7e4f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:17.674912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 639/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:08:17 2022] GET /identity/v3/role_assignments?user.id=8463ca23f8c447dfad7ae62e7ba084e5&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:19.697776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f92f0-acc3-4374-b497-9a206ff78aae None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:19.698322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f92f0-acc3-4374-b497-9a206ff78aae None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:19.698322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f92f0-acc3-4374-b497-9a206ff78aae None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:19.699745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 622/1261] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:19.704772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:19.705172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:19.705327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:19.721707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:19.722883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:19.795788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 640/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:19.819598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f92f0-acc3-4374-b497-9a206ff78aae None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:19.830307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:19.918657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f92f0-acc3-4374-b497-9a206ff78aae None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:19.955482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:19.956197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:19.956483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:19.956762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:19.966649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:08:19.974822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:19.975936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:19.976824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 623/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:19.982016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:20.001139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:20.082536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9002-9ba0-4433-8732-e33ec3e3828b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:20.115930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:20.116595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:20.116882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:20.117162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:20.117904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:20.118212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:20.119598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:20.127590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 641/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:08:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:20.133393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:20.203623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:20.241045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4571911-bab2-411d-92d3-9ec62b680944 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:20.277569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:20.278355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:20.278643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:20.278924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:20.292878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:20.294327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:20.313970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:20.315079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:20.316433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:20.316433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:20.316433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:20.316433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:20.316433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 624/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:20.321226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:20.407183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:20.428937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c54d-7ba8-46e9-9f5d-31e0fd8b1348 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:20.463580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:20.464241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:20.464529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:20.464812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:20.465730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:20.466282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:20.468564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:20.481175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 642/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:20.486848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:20.599196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f6b7e-d750-4717-ba9f-6870e4b9b186 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:20.620682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:20.635590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:20.636391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:20.636675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:20.637004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:20.645071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:20.646500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:08:20.660805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:20.661913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:20.663273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 625/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:20.667807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:20.780901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec195a44-f1f6-4f25-baf4-0cf81855632d None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:20.815217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:20.815904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:20.816186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:20.816464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:20.817288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:20.817602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:20.819020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:20.827654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:20.838654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 643/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jun 29 11:08:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:20.844505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:20.942904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f9559-1ca2-4557-9587-0918082cfcff None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:20.975729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:20.976505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:20.976792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:20.977071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:20.987822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:20.989256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:21.007247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:21.008305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:21.009558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:21.009558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:21.009558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:21.009558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:21.009558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 626/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:21.014077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:21.111929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a29d4-66d5-4cfc-94c5-645f119a77de None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:21.144969 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:21.145623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:21.145910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:21.146188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:21.146896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:21.147243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:21.148585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:21.161383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 644/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:21.167238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:21.199029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:21.266704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcde0bd-468c-4eb6-a859-8f5a51e89465 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:21.299177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:21.299956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:21.300246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:21.300526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:21.307306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:21.308743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:08:21.323308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:21.324372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:21.325483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 627/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:21.330398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:21.387452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:21.429606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0341c-9fc0-4ece-afa1-89614f32b319 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:21.462231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:21.462829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:21.463148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:21.463437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:21.464218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:21.464533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:21.465948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f8fe2-9109-450e-bdf3-aaff73c80281 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:21.478232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 645/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:21.484122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:21.572026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:21.580717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf6aff-1d16-4307-916d-50a539417494 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:21.613861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1d21e-9831-4e27-b848-653f8f4a30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:21.614717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d21e-9831-4e27-b848-653f8f4a30b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:21.615002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d21e-9831-4e27-b848-653f8f4a30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:21.615308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1d21e-9831-4e27-b848-653f8f4a30b7 None admin] PATH_INFO: `/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/8463ca23f8c447dfad7ae62e7ba084e5/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:21.617222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1d21e-9831-4e27-b848-653f8f4a30b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c61084d9278a48c4a3bbe355525e62a6, user_id=8463ca23f8c447dfad7ae62e7ba084e5, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:21.618647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1d21e-9831-4e27-b848-653f8f4a30b7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:21.630591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 628/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jun 29 11:08:21 2022] PUT /identity/v3/projects/c61084d9278a48c4a3bbe355525e62a6/users/8463ca23f8c447dfad7ae62e7ba084e5/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:08:23.619065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e6a0-3a5a-4b19-8bd1-bb899d9862e0 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:23.619622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e6a0-3a5a-4b19-8bd1-bb899d9862e0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:23.619622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e6a0-3a5a-4b19-8bd1-bb899d9862e0 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:23.621013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 646/1274] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:23.626089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:23.626504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:23.626648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:23.643679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:23.644846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:23.716745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 629/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:23.741233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e6a0-3a5a-4b19-8bd1-bb899d9862e0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:23.845836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e6a0-3a5a-4b19-8bd1-bb899d9862e0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:23.862165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:23.879255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:23.879975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:23.880258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:23.880533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:23.890255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 11:08:23.898448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:23.899571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:23.900832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 647/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jun 29 11:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:23.905599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:23.982761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:24.002613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4c339-247b-4f0d-94bf-76529f8f9b6f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:24.035771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:24.036420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:24.036705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:24.036980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:24.037710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:24.038015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:24.039392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:24.047080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 630/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jun 29 11:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:24.052719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:24.150483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e518c-d561-4bf3-9a07-998f5de7ebe9 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:24.183054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:24.183841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:24.184128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:24.184402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:24.194673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:24.196124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:24.213206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:24.214265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:24.215289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:24.215289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:24.215289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:24.215289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:24.215289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 648/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:24.220664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:24.316915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b8de-04fa-4f84-a3c5-0840311ed66d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:24.349963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:24.350612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:24.350899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:24.351213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:24.351924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:24.352232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:24.353582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:24.364869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 631/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:24.370202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:24.401131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:24.469147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf39a69-2111-479c-8abd-b8f9c1f42220 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:24.500742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:24.502052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:24.502336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:24.502614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:24.509761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:24.511222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 11:08:24.525562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:24.526531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:24.527657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 649/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:24.532243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:24.535969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:24.629064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530317-ee60-4556-a2f8-bd860192d9b4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:24.661623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:24.662224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:24.662516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:24.662798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:24.663650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:24.663964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:24.665379 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:24.681887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 632/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jun 29 11:08:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:24.687333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:24.780547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:24.790259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd83af-26d9-4a47-84ce-458e95f65519 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:24.824071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:24.824713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:24.825060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:24.825416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:24.890644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:24.892132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:24.982664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:24.993768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 650/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jun 29 11:08:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 11:08:24.999501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:25.059274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:25.096716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbd5e2-cef4-4b89-8157-75060aed39e2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:25.129369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:25.130145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:25.130426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:25.130701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:25.140352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:25.141785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 11:08:25.159896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:25.161585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:25.163690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 11:08:25.163690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 11:08:25.163690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 11:08:25.163690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:25.163690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 633/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:25.171268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:25.268249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8c17-e474-47de-978a-2036cff6b678 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:25.303229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:25.304135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:25.304418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:25.304695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:25.305404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:25.305708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:25.307177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:25.317992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 651/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jun 29 11:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:25.323583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:25.419164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a493798-edb9-4db1-9ed1-88ac5e06435a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:25.433296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:25.452896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:25.453670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:25.453950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:25.454218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:25.460627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:25.462043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 11:08:25.475868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:25.476906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jun 29 11:08:25.477972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 634/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jun 29 11:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:25.482672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:25.532713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:25.580937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e72aa3-f3e9-4e8b-884b-d4a8f8157276 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:25.613011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:25.613655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:25.613940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:25.614213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:25.614986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:25.615321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:25.616719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006d80e-2694-4974-b94f-5d1e6b00890f None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:25.628450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 652/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jun 29 11:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:25.634177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:25.732768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4d7a0-4bf2-4ede-9fe8-248c9180b542 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:25.764540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:25.765176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:25.765461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:25.765740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:25.767111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] RBAC: Adding query filter params (role.id=578ff99b6c984bc68a9c8cc5d9181c48, scope.project.id=c61084d9278a48c4a3bbe355525e62a6, user.id=8463ca23f8c447dfad7ae62e7ba084e5) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:25.767430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:25.768843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91e4c1-c0b4-48b2-8d6f-cd10faf0cbc4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:25.774482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 635/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jun 29 11:08:25 2022] GET /identity/v3/role_assignments?user.id=8463ca23f8c447dfad7ae62e7ba084e5&scope.project.id=c61084d9278a48c4a3bbe355525e62a6&role.id=578ff99b6c984bc68a9c8cc5d9181c48 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:27.780673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbcb1-f601-4ecf-ba0a-c79106c9ac97 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:27.781192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbcb1-f601-4ecf-ba0a-c79106c9ac97 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:27.781305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccbcb1-f601-4ecf-ba0a-c79106c9ac97 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:27.782601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 653/1288] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:27.787685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:27.788121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:27.788243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:27.805247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:27.806402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:27.835637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:27.871932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 636/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:27.894454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccbcb1-f601-4ecf-ba0a-c79106c9ac97 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:28.000024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccbcb1-f601-4ecf-ba0a-c79106c9ac97 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:28.011131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:28.033852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:28.034582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:28.034866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:28.035175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:28.035821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:28.037179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:28.049231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:28.050435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:28.051615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 654/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:08:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:28.056526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:28.154998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2b0d2-2d45-47aa-8eff-720835327052 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:28.188819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:28.189474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:28.189761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:28.190041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:28.190740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:28.191073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:28.192443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979cfb-de76-419b-80da-e579da71ef0c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:28.197162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 637/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jun 29 11:08:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:28.202910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:28.300620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b398641-11ca-459e-b791-2176a617f336 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:28.332561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:28.333211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:28.333498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:28.333780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] PATH_INFO: `/v3/services` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:28.334475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] RBAC: Adding query filter params (type=placement) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:28.334784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:28.336161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0d09-c7f3-4444-8fa9-4f4621187fbc None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:28.340469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 655/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jun 29 11:08:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:30.345420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b38b-254a-457c-96d8-eb709d1ea0dd None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:30.345978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b38b-254a-457c-96d8-eb709d1ea0dd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:30.345978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b38b-254a-457c-96d8-eb709d1ea0dd None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:30.347382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 638/1293] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:30.352321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da2e6-8d11-4272-bb1e-9f75d45c1065 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:30.352764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da2e6-8d11-4272-bb1e-9f75d45c1065 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:30.352872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da2e6-8d11-4272-bb1e-9f75d45c1065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:30.369997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b50da2e6-8d11-4272-bb1e-9f75d45c1065 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:30.371216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b50da2e6-8d11-4272-bb1e-9f75d45c1065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:30.399478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:30.436844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 656/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:30.459305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b38b-254a-457c-96d8-eb709d1ea0dd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:30.490403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:30.558479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b38b-254a-457c-96d8-eb709d1ea0dd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:30.590494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879d6b6-4c49-415b-ab25-ea511f11321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:30.591163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d6b6-4c49-415b-ab25-ea511f11321b None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:30.591452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d6b6-4c49-415b-ab25-ea511f11321b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:30.591734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879d6b6-4c49-415b-ab25-ea511f11321b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:30.592457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879d6b6-4c49-415b-ab25-ea511f11321b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:30.593814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879d6b6-4c49-415b-ab25-ea511f11321b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:30.606807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 639/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jun 29 11:08:30 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:08:32.636675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b78b6-8ea1-4db2-b2da-8cccb3062144 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:32.637204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b78b6-8ea1-4db2-b2da-8cccb3062144 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:32.637331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b78b6-8ea1-4db2-b2da-8cccb3062144 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:32.638587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 657/1296] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:32.643736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fb896-190b-4788-a138-8835dab81bdd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:32.644166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fb896-190b-4788-a138-8835dab81bdd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:32.644310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fb896-190b-4788-a138-8835dab81bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:32.661228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-375fb896-190b-4788-a138-8835dab81bdd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:32.662410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-375fb896-190b-4788-a138-8835dab81bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:32.737480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 640/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:32.762821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b78b6-8ea1-4db2-b2da-8cccb3062144 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:32.872291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b78b6-8ea1-4db2-b2da-8cccb3062144 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:32.904455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:32.905194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:32.905483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:32.905763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:32.906438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:32.908323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:32.919944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:32.921182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:32.922314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 658/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:08:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:32.927938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fb896-190b-4788-a138-8835dab81bdd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:32.946004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:33.025472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fb896-190b-4788-a138-8835dab81bdd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:33.058594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:33.059282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:33.059569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:33.059844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:33.060542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:33.060851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:33.062212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:33.067282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 641/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jun 29 11:08:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:33.073120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:33.104585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:33.171061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db8a92-9a57-4609-8bbf-d53af39d7529 None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:33.203403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:33.204589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:33.204879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:33.205157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:33.205932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] RBAC: Adding query filter params (interface=public, service_id=f3b20859e37a40ff9d2477d91eba3f6f, region_id=RegionOne) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:33.206241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:33.207613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ac9ea-bf71-47fa-9e08-9f4e8b7f63f5 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:33.212522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 659/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jun 29 11:08:33 2022] GET /identity/v3/endpoints?service_id=f3b20859e37a40ff9d2477d91eba3f6f&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:08:33.218053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:33.298746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:33.316821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee80033-41e6-4618-a1fc-7bb051a6c4c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:33.349703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73c9cf-24e5-42a8-ab90-31761f6bf636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:33.350351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73c9cf-24e5-42a8-ab90-31761f6bf636 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:33.350634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73c9cf-24e5-42a8-ab90-31761f6bf636 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:33.350906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73c9cf-24e5-42a8-ab90-31761f6bf636 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:33.351605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73c9cf-24e5-42a8-ab90-31761f6bf636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:33.352956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73c9cf-24e5-42a8-ab90-31761f6bf636 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:33.359546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 642/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jun 29 11:08:33 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:08:35.366005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadfe1-c503-4be3-ac86-54d2fcbee9ac None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:35.366521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadfe1-c503-4be3-ac86-54d2fcbee9ac None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:35.366637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadfe1-c503-4be3-ac86-54d2fcbee9ac None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:35.367967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 660/1302] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:08:35.373089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:35.373457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:35.373649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:35.389931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:08:35.391719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:08:35.455719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 643/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:08:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 11:08:35.479061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadfe1-c503-4be3-ac86-54d2fcbee9ac None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:35.570329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:35.577101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadfe1-c503-4be3-ac86-54d2fcbee9ac None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:35.610456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:35.611256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:35.611538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:35.611813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:35.612451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:35.613809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 11:08:35.625222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 11:08:35.626896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application with Lock( Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self._enter() Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application return self.creator() Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application created_value = creator( Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: ERROR keystone.server.flask.application Jun 29 11:08:35.627956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 661/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jun 29 11:08:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 11:08:35.632866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:35.706612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:35.732586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0542e9f-60bc-4fbf-8364-a40173f70f16 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:35.773279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:35.773975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:35.774307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:35.774617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:35.775497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:08:35.776040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:35.777484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf77ca2-e6d0-4816-b643-a075eb996cbd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:35.783744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 644/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jun 29 11:08:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:08:35.789682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:08:35.885657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab068-ead7-45da-ade7-4e44e2cb626e None admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:08:35.917650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ebb70-953a-4568-a5f6-96f91e139c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:08:35.918283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ebb70-953a-4568-a5f6-96f91e139c75 None admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:08:35.918566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ebb70-953a-4568-a5f6-96f91e139c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:08:35.918842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ebb70-953a-4568-a5f6-96f91e139c75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:08:35.919601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ebb70-953a-4568-a5f6-96f91e139c75 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:08:35.920947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ebb70-953a-4568-a5f6-96f91e139c75 None admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:08:35.938878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 662/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jun 29 11:08:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:08:45.780673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=30 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:08:45.934210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:38.215921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6391-66bd-476e-8e54-1cb4568d9dea None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:38.216406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6391-66bd-476e-8e54-1cb4568d9dea None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:38.216488 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6391-66bd-476e-8e54-1cb4568d9dea None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:38.224154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a50563-0180-4d72-890d-80ca2fc673db None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:38.224585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a50563-0180-4d72-890d-80ca2fc673db None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:38.224710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a50563-0180-4d72-890d-80ca2fc673db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:38.228796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 645/1307] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:38.328726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-93a50563-0180-4d72-890d-80ca2fc673db None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:38.329922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-93a50563-0180-4d72-890d-80ca2fc673db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:38.459693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 663/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:09:38.513988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9cd2c-fd33-4f9a-809b-5b96e92aadb7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:38.514578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9cd2c-fd33-4f9a-809b-5b96e92aadb7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:38.515280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9cd2c-fd33-4f9a-809b-5b96e92aadb7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:38.517520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 646/1309] 10.222.0.48 () {54 vars in 964 bytes} [Wed Jun 29 11:09:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:38.525581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c693f39-83a6-4758-8c0e-c1f68e6a3b9d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:38.526127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c693f39-83a6-4758-8c0e-c1f68e6a3b9d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:38.526589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c693f39-83a6-4758-8c0e-c1f68e6a3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:38.610141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0c693f39-83a6-4758-8c0e-c1f68e6a3b9d None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:38.611382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0c693f39-83a6-4758-8c0e-c1f68e6a3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:38.632478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:38.690727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 664/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Jun 29 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:38.699425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9cd2c-fd33-4f9a-809b-5b96e92aadb7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:38.701135 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-82d9cd2c-fd33-4f9a-809b-5b96e92aadb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:38.814470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9cd2c-fd33-4f9a-809b-5b96e92aadb7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:38.896137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:38.897070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:38.897502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:38.898029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:38.899938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:38.962248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:39.026279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:39.027753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf5077-1dd7-4caa-bf6b-21718b54409f service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:39.048216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 647/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:41.359670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f925f1-fdb7-4d69-abe3-df71b2c53d59 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:41.360202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f925f1-fdb7-4d69-abe3-df71b2c53d59 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:41.360202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f925f1-fdb7-4d69-abe3-df71b2c53d59 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:41.361571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 665/1312] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:41.366632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82067-89eb-4879-9c48-80fa72727f5f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:41.367060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82067-89eb-4879-9c48-80fa72727f5f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:41.367350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82067-89eb-4879-9c48-80fa72727f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:41.440992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-09f82067-89eb-4879-9c48-80fa72727f5f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:41.442208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-09f82067-89eb-4879-9c48-80fa72727f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:41.540269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 648/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:41.579987 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f925f1-fdb7-4d69-abe3-df71b2c53d59 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:41.581525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-46f925f1-fdb7-4d69-abe3-df71b2c53d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:41.691326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f925f1-fdb7-4d69-abe3-df71b2c53d59 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:41.762331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:41.765006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:41.765674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:41.766237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:41.766781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:41.768736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:41.880607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:41.882053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4cab-1b39-4c7e-9245-2ba0474cb135 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:41.903016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 666/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:44.237957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b11d5-15b5-495b-b8ed-0b60bcc00f00 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:44.238460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b11d5-15b5-495b-b8ed-0b60bcc00f00 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:44.238460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b11d5-15b5-495b-b8ed-0b60bcc00f00 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:44.239961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 649/1315] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:44.245023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07dd76-81ca-4ca9-a857-45871fcb5af3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:44.245430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07dd76-81ca-4ca9-a857-45871fcb5af3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:44.245598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07dd76-81ca-4ca9-a857-45871fcb5af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:44.312274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5d07dd76-81ca-4ca9-a857-45871fcb5af3 None None] MFA Rules not processed for user `3d323dabd4b9465085858a1023b364cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:44.313500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5d07dd76-81ca-4ca9-a857-45871fcb5af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:44.366070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:44.412676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 667/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:44.464614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b8de-c78d-4d15-a521-7a4dde511468 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:44.464981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b8de-c78d-4d15-a521-7a4dde511468 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:44.465327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173b8de-c78d-4d15-a521-7a4dde511468 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:44.466699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 650/1317] 10.222.0.48 () {54 vars in 964 bytes} [Wed Jun 29 11:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:44.473161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6809537-042f-4ce6-b848-66278b7ab7b9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:44.473458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6809537-042f-4ce6-b848-66278b7ab7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:44.473740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6809537-042f-4ce6-b848-66278b7ab7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:44.552901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c6809537-042f-4ce6-b848-66278b7ab7b9 None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:44.554297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c6809537-042f-4ce6-b848-66278b7ab7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:44.630313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 668/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Jun 29 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:44.640117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b8de-c78d-4d15-a521-7a4dde511468 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:44.641672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3173b8de-c78d-4d15-a521-7a4dde511468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:44.651995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:44.747700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173b8de-c78d-4d15-a521-7a4dde511468 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:44.822960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:44.823677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:44.823969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:44.824253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:44.825952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:44.886899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:44.933417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:44.934844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa822b-02af-4e79-9dab-cb8c1fd0a5ed service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:44.953642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 651/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:47.850802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3430-6650-440f-8646-0dcc7c2481d7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:47.851401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3430-6650-440f-8646-0dcc7c2481d7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:47.851401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f3430-6650-440f-8646-0dcc7c2481d7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:47.852758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 669/1320] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:47.857927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff688b9-7ee2-49c9-bfd1-b57d037bb69c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:47.858899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff688b9-7ee2-49c9-bfd1-b57d037bb69c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:47.859184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff688b9-7ee2-49c9-bfd1-b57d037bb69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:47.922831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7ff688b9-7ee2-49c9-bfd1-b57d037bb69c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:47.924048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ff688b9-7ee2-49c9-bfd1-b57d037bb69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:48.024259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 652/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:48.063948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3430-6650-440f-8646-0dcc7c2481d7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:48.065447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fa4f3430-6650-440f-8646-0dcc7c2481d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:48.114184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:48.167342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f3430-6650-440f-8646-0dcc7c2481d7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:48.239579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:48.240234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:48.240518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:48.240792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:48.242396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:48.339548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:48.353740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:48.355204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d33c-b091-4d39-b097-74e6e167591b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:48.373522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 670/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:51.071444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79bdc-792e-4d3f-8e31-1ee80abec18a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:51.071938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79bdc-792e-4d3f-8e31-1ee80abec18a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:51.072048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d79bdc-792e-4d3f-8e31-1ee80abec18a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:51.073525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 653/1323] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:51.078703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a52d5-aa36-46c7-ad7f-d84b5a2e69e3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:51.079181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a52d5-aa36-46c7-ad7f-d84b5a2e69e3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:51.079288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a52d5-aa36-46c7-ad7f-d84b5a2e69e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:51.144518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8c1a52d5-aa36-46c7-ad7f-d84b5a2e69e3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:51.145706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8c1a52d5-aa36-46c7-ad7f-d84b5a2e69e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:51.250986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 671/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:51.287802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79bdc-792e-4d3f-8e31-1ee80abec18a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:51.289450 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-52d79bdc-792e-4d3f-8e31-1ee80abec18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:51.309732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:51.398637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d79bdc-792e-4d3f-8e31-1ee80abec18a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:51.472576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:51.473330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:51.473617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:51.473891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:51.475548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:51.545858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:51.584620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:51.585990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632fe96-67b6-453d-b193-36e8343294d1 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:51.604484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 654/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:53.688889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcc33f-5603-4ba7-8365-1c24b08887bf None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:53.689400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcc33f-5603-4ba7-8365-1c24b08887bf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:53.689400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcc33f-5603-4ba7-8365-1c24b08887bf None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:53.690728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 672/1326] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:09:53.695923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81db20f-f7c8-4cac-b539-1c0793c65bb8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:53.696361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81db20f-f7c8-4cac-b539-1c0793c65bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:53.696489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81db20f-f7c8-4cac-b539-1c0793c65bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:53.763209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c81db20f-f7c8-4cac-b539-1c0793c65bb8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:53.764492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c81db20f-f7c8-4cac-b539-1c0793c65bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:53.861997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 655/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:53.896777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcc33f-5603-4ba7-8365-1c24b08887bf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:53.898296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aefcc33f-5603-4ba7-8365-1c24b08887bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:53.960463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:54.005643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcc33f-5603-4ba7-8365-1c24b08887bf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:54.085022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:54.085679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:54.085970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:54.086248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:54.087966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:54.195139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:54.197673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:54.199780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cfee2-94bd-4825-9550-78f4c0632b64 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:54.219094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 673/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:56.320170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1053e-457e-4083-a523-d09ca8e3215d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:56.320676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1053e-457e-4083-a523-d09ca8e3215d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:56.320768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1053e-457e-4083-a523-d09ca8e3215d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:56.322112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 656/1329] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:56.327229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8747c6-ba24-46d9-bd48-4dabe987f416 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:56.327635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8747c6-ba24-46d9-bd48-4dabe987f416 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:56.327914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8747c6-ba24-46d9-bd48-4dabe987f416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:56.395225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5c8747c6-ba24-46d9-bd48-4dabe987f416 None None] MFA Rules not processed for user `3d323dabd4b9465085858a1023b364cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:56.396487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5c8747c6-ba24-46d9-bd48-4dabe987f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:56.497457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 674/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:56 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:09:56.534524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1053e-457e-4083-a523-d09ca8e3215d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:56.536098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1fb1053e-457e-4083-a523-d09ca8e3215d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:56.571215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:56.644232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1053e-457e-4083-a523-d09ca8e3215d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:56.719450 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:56.720096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:56.720378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:56.720652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:56.722317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:56.800125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:56.849071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:56.850529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825376e7-8607-47b6-8715-74b917ecb6dd service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:56.869400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 657/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:09:59.151763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111fb36-0805-4d6d-8ce9-a45fafaaf55d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:59.152311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111fb36-0805-4d6d-8ce9-a45fafaaf55d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:59.152311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111fb36-0805-4d6d-8ce9-a45fafaaf55d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:59.153719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 675/1332] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:09:59.158882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c0c8-ce56-4dfd-9bc2-71a4d2d32028 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:59.159311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c0c8-ce56-4dfd-9bc2-71a4d2d32028 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:59.159479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c0c8-ce56-4dfd-9bc2-71a4d2d32028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:59.222860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4447c0c8-ce56-4dfd-9bc2-71a4d2d32028 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:09:59.224023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4447c0c8-ce56-4dfd-9bc2-71a4d2d32028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:59.319494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 658/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:09:59.354600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111fb36-0805-4d6d-8ce9-a45fafaaf55d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:09:59.356160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1111fb36-0805-4d6d-8ce9-a45fafaaf55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:59.423985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:59.458113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111fb36-0805-4d6d-8ce9-a45fafaaf55d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:09:59.528870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:09:59.529449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:09:59.529759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:09:59.530035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:09:59.531695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:09:59.642721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:09:59.644196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d8e3d-de1f-4205-a39c-1c69f07a2d65 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:09:59.653946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:09:59.663352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 676/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:01.734223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c4ea3-287e-4dab-92ce-5686d8b4b023 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:01.734833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c4ea3-287e-4dab-92ce-5686d8b4b023 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:01.734973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c4ea3-287e-4dab-92ce-5686d8b4b023 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:01.736336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 659/1335] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:01.741548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c954e63-7fc0-4607-ab81-289a9f976386 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:01.741983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c954e63-7fc0-4607-ab81-289a9f976386 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:01.742112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c954e63-7fc0-4607-ab81-289a9f976386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:01.806327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3c954e63-7fc0-4607-ab81-289a9f976386 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:01.807537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c954e63-7fc0-4607-ab81-289a9f976386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:01.902411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 677/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:01.947484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c4ea3-287e-4dab-92ce-5686d8b4b023 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:01.949022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b14c4ea3-287e-4dab-92ce-5686d8b4b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:01.988977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:02.054828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c4ea3-287e-4dab-92ce-5686d8b4b023 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:02.127268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:02.127916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:02.128203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:02.128483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:02.130109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:02.212250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:02.238892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:02.240446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618a0d1-a6e6-455c-a881-9f248b993776 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:02.259627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 660/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:04.589690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55303-b920-4839-b60c-020168dffd63 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:04.590257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55303-b920-4839-b60c-020168dffd63 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:04.590257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55303-b920-4839-b60c-020168dffd63 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:04.591642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 678/1338] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:04.597302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13618e10-7497-45bf-99d8-a043de4c5f02 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:04.597686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13618e10-7497-45bf-99d8-a043de4c5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:04.597868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13618e10-7497-45bf-99d8-a043de4c5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:04.661025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-13618e10-7497-45bf-99d8-a043de4c5f02 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:04.662241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-13618e10-7497-45bf-99d8-a043de4c5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:04.763246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 661/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:04.798772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55303-b920-4839-b60c-020168dffd63 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:04.800326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-21c55303-b920-4839-b60c-020168dffd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:04.876602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:04.909440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55303-b920-4839-b60c-020168dffd63 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:04.981139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:04.981798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:04.982092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:04.982379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:04.984644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:05.096238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:05.097677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f4114-d6ae-4df6-bf83-1f8240f7dbfe service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:05.116117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 679/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:09.066792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75c8b3-8d70-470a-a291-39a1c067ae65 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:09.067374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75c8b3-8d70-470a-a291-39a1c067ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:09.067374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75c8b3-8d70-470a-a291-39a1c067ae65 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:09.068746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 662/1341] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:09.074110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24bd48-a324-43b0-aac2-5b6e5f8ce149 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:09.074547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24bd48-a324-43b0-aac2-5b6e5f8ce149 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:09.074673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24bd48-a324-43b0-aac2-5b6e5f8ce149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:09.080842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:09.146134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ef24bd48-a324-43b0-aac2-5b6e5f8ce149 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:09.147360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ef24bd48-a324-43b0-aac2-5b6e5f8ce149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:09.250728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 680/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:09.288525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75c8b3-8d70-470a-a291-39a1c067ae65 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:09.290610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d75c8b3-8d70-470a-a291-39a1c067ae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:09.340627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:09.386682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75c8b3-8d70-470a-a291-39a1c067ae65 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:09.390301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18aa6a-c0d3-48e4-aefc-9846d72f8dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:09.390944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18aa6a-c0d3-48e4-aefc-9846d72f8dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:09.391255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18aa6a-c0d3-48e4-aefc-9846d72f8dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:09.391535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18aa6a-c0d3-48e4-aefc-9846d72f8dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:09.400580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18aa6a-c0d3-48e4-aefc-9846d72f8dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:09.402028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18aa6a-c0d3-48e4-aefc-9846d72f8dbc service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:09.411770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 663/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:12.120123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22baf-e7be-4e8f-a02d-fb9dda728462 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:12.120697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22baf-e7be-4e8f-a02d-fb9dda728462 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:12.120697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe22baf-e7be-4e8f-a02d-fb9dda728462 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:12.122083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 681/1344] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:12.128880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631277d-4e41-4f94-af5d-856e5a5f23b0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:12.128880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631277d-4e41-4f94-af5d-856e5a5f23b0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:12.128880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631277d-4e41-4f94-af5d-856e5a5f23b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:12.159445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f631277d-4e41-4f94-af5d-856e5a5f23b0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:12.160660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f631277d-4e41-4f94-af5d-856e5a5f23b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:12.244585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 664/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:12.283010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22baf-e7be-4e8f-a02d-fb9dda728462 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:12.294333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe22baf-e7be-4e8f-a02d-fb9dda728462 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:12.298038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21883b-91f6-4909-8da0-4682fba04f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:12.298760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21883b-91f6-4909-8da0-4682fba04f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:12.299069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21883b-91f6-4909-8da0-4682fba04f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:12.299372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21883b-91f6-4909-8da0-4682fba04f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:12.309316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21883b-91f6-4909-8da0-4682fba04f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:12.310745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21883b-91f6-4909-8da0-4682fba04f6d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:12.320393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 682/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:16.284105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27444-9086-4d3c-919b-9686962d0e2a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:16.284629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27444-9086-4d3c-919b-9686962d0e2a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:16.284769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb27444-9086-4d3c-919b-9686962d0e2a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:16.286648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 665/1347] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:16.292095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98dc44-70f4-4918-8e8d-16e022fb754a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:16.292570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98dc44-70f4-4918-8e8d-16e022fb754a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:16.292688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98dc44-70f4-4918-8e8d-16e022fb754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:16.310701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fc98dc44-70f4-4918-8e8d-16e022fb754a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:16.311959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fc98dc44-70f4-4918-8e8d-16e022fb754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:16.320075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 683/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:16.358123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb27444-9086-4d3c-919b-9686962d0e2a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:16.374979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb27444-9086-4d3c-919b-9686962d0e2a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:16.378681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff168b9-9c07-42b1-8b75-a73088680a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:16.379382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff168b9-9c07-42b1-8b75-a73088680a61 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:16.379669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff168b9-9c07-42b1-8b75-a73088680a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:16.379951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff168b9-9c07-42b1-8b75-a73088680a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:16.389735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff168b9-9c07-42b1-8b75-a73088680a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:16.391218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff168b9-9c07-42b1-8b75-a73088680a61 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:16.400855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 666/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:21.410614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068e8f3-fd00-4642-a0d7-6e09ea3e3498 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:21.410614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068e8f3-fd00-4642-a0d7-6e09ea3e3498 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:21.410614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068e8f3-fd00-4642-a0d7-6e09ea3e3498 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:21.411946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 684/1350] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:21.418152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee18b0-1268-4f00-a94b-e5e42db28c53 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:21.419001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee18b0-1268-4f00-a94b-e5e42db28c53 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:21.419456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee18b0-1268-4f00-a94b-e5e42db28c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:21.553662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-93ee18b0-1268-4f00-a94b-e5e42db28c53 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:21.555417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-93ee18b0-1268-4f00-a94b-e5e42db28c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:21.591557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:21.653847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 667/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:25.976283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b83c79-02f8-4506-a7cf-ffbf1bd2d0ab None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:25.976802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b83c79-02f8-4506-a7cf-ffbf1bd2d0ab None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:25.976884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b83c79-02f8-4506-a7cf-ffbf1bd2d0ab None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:25.978457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 685/1352] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:25.983761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e06c1-633b-478a-ab88-9f49908df2ee None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:25.984212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e06c1-633b-478a-ab88-9f49908df2ee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:25.984316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e06c1-633b-478a-ab88-9f49908df2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:26.015255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f68e06c1-633b-478a-ab88-9f49908df2ee None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:26.016581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f68e06c1-633b-478a-ab88-9f49908df2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:26.025414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 668/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:10:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:26.305535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=72 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:27.322293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1fbc7-3a76-400d-900c-9f765121ae5e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:27.322927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1fbc7-3a76-400d-900c-9f765121ae5e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:27.323023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1fbc7-3a76-400d-900c-9f765121ae5e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:27.324506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 686/1354] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:27.329748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b22ee-1db8-4643-b4d9-2615d98b5800 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:27.330165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b22ee-1db8-4643-b4d9-2615d98b5800 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:27.330308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b22ee-1db8-4643-b4d9-2615d98b5800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:27.348426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9c9b22ee-1db8-4643-b4d9-2615d98b5800 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:27.349624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c9b22ee-1db8-4643-b4d9-2615d98b5800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:27.358509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 669/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:30.913301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e953c-e931-45c6-be67-2884a11db12b None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:30.913852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e953c-e931-45c6-be67-2884a11db12b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:30.913852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e953c-e931-45c6-be67-2884a11db12b None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:30.916535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 687/1356] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:30.921539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc886-b5ea-4335-962a-a315b431934d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:30.922419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc886-b5ea-4335-962a-a315b431934d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:30.922931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc886-b5ea-4335-962a-a315b431934d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:30.958587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d46fc886-b5ea-4335-962a-a315b431934d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:30.961121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d46fc886-b5ea-4335-962a-a315b431934d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:30.971708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 670/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:10:31.029989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922f3e-b191-4f00-a578-8ff4c98a2c7e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:31.030657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922f3e-b191-4f00-a578-8ff4c98a2c7e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:31.031205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77922f3e-b191-4f00-a578-8ff4c98a2c7e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:31.033761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 688/1358] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jun 29 11:10:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:31.042035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432d5e-cf26-460a-b260-95bebf9ad563 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:31.043630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432d5e-cf26-460a-b260-95bebf9ad563 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:31.043942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31432d5e-cf26-460a-b260-95bebf9ad563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:31.096663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-31432d5e-cf26-460a-b260-95bebf9ad563 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:31.097852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31432d5e-cf26-460a-b260-95bebf9ad563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:31.181918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 671/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jun 29 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:10:31.190755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922f3e-b191-4f00-a578-8ff4c98a2c7e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:31.206872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77922f3e-b191-4f00-a578-8ff4c98a2c7e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:31.213374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc0f80-876d-4a7b-9e95-d6a92637a151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:31.214135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0f80-876d-4a7b-9e95-d6a92637a151 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:31.214525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0f80-876d-4a7b-9e95-d6a92637a151 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:31.214901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0f80-876d-4a7b-9e95-d6a92637a151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:31.224029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc0f80-876d-4a7b-9e95-d6a92637a151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:31.225737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc0f80-876d-4a7b-9e95-d6a92637a151 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:31.235834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 689/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:33.484336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c9751-951c-4d44-8ac2-ac4479a8d45c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:33.484916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c9751-951c-4d44-8ac2-ac4479a8d45c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:33.484916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c9751-951c-4d44-8ac2-ac4479a8d45c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:33.486403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 672/1361] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:33.491494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060fa54-a56a-4186-bb06-3238284dda4c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:33.491955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060fa54-a56a-4186-bb06-3238284dda4c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:33.492056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060fa54-a56a-4186-bb06-3238284dda4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:33.510519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7060fa54-a56a-4186-bb06-3238284dda4c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:33.511728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7060fa54-a56a-4186-bb06-3238284dda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:33.520310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 690/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:33.564205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c9751-951c-4d44-8ac2-ac4479a8d45c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:33.580018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c9751-951c-4d44-8ac2-ac4479a8d45c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:33.585416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f46d-09db-4bda-be92-c81a1f80d287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:33.586049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f46d-09db-4bda-be92-c81a1f80d287 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:33.586337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f46d-09db-4bda-be92-c81a1f80d287 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:33.586623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f46d-09db-4bda-be92-c81a1f80d287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:33.594924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958f46d-09db-4bda-be92-c81a1f80d287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:33.596549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958f46d-09db-4bda-be92-c81a1f80d287 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:33.606114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 673/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:35.961346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5efcf0-97de-41dc-bf22-fa631fad78b4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:35.961812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5efcf0-97de-41dc-bf22-fa631fad78b4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:35.961935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5efcf0-97de-41dc-bf22-fa631fad78b4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:35.963498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 691/1364] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:35.968754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f619c-e0d2-4e4d-bb92-96044f7e5a05 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:35.969175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f619c-e0d2-4e4d-bb92-96044f7e5a05 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:35.969320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f619c-e0d2-4e4d-bb92-96044f7e5a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:35.988078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-666f619c-e0d2-4e4d-bb92-96044f7e5a05 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:35.989275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-666f619c-e0d2-4e4d-bb92-96044f7e5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:35.998352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 674/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:36.045414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66519d00-efae-4086-bc33-d96be4368c8f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:36.045857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66519d00-efae-4086-bc33-d96be4368c8f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:36.046057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66519d00-efae-4086-bc33-d96be4368c8f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:36.047923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 692/1366] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jun 29 11:10:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:36.054484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce35e-be75-4d0d-a7d7-537e54049132 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:36.054780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce35e-be75-4d0d-a7d7-537e54049132 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:36.055113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dce35e-be75-4d0d-a7d7-537e54049132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:36.082433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f2dce35e-be75-4d0d-a7d7-537e54049132 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:36.083665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f2dce35e-be75-4d0d-a7d7-537e54049132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:36.093599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 675/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jun 29 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:36.101999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66519d00-efae-4086-bc33-d96be4368c8f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:36.117023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66519d00-efae-4086-bc33-d96be4368c8f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:36.122489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b3d66-470d-43b1-a5b9-c6e28950311f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:36.123700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b3d66-470d-43b1-a5b9-c6e28950311f service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:36.123992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b3d66-470d-43b1-a5b9-c6e28950311f service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:36.124289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b3d66-470d-43b1-a5b9-c6e28950311f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:36.132973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b3d66-470d-43b1-a5b9-c6e28950311f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:36.134561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b3d66-470d-43b1-a5b9-c6e28950311f service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:36.144246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 693/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:38.242013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4106546-db8f-4cb8-b9f1-f1ca55abcbff None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:38.242544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4106546-db8f-4cb8-b9f1-f1ca55abcbff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:38.242544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4106546-db8f-4cb8-b9f1-f1ca55abcbff None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:38.243894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 676/1369] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:38.249738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f781da5-a7fa-40f0-8001-e5b1e43749e5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:38.250176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f781da5-a7fa-40f0-8001-e5b1e43749e5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:38.250292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f781da5-a7fa-40f0-8001-e5b1e43749e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:38.268142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4f781da5-a7fa-40f0-8001-e5b1e43749e5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:38.269305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4f781da5-a7fa-40f0-8001-e5b1e43749e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:38.277162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 694/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:38.324245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4106546-db8f-4cb8-b9f1-f1ca55abcbff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:38.341780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4106546-db8f-4cb8-b9f1-f1ca55abcbff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:38.348162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f6be-9118-42c9-8172-d25236dff677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:38.349011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f6be-9118-42c9-8172-d25236dff677 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:38.349582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f6be-9118-42c9-8172-d25236dff677 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:38.350020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f6be-9118-42c9-8172-d25236dff677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:38.361911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86f6be-9118-42c9-8172-d25236dff677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:38.364410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86f6be-9118-42c9-8172-d25236dff677 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:38.377094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 677/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:39.069987 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb72c-e305-4775-ab19-51931fdf9e57 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:39.070553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb72c-e305-4775-ab19-51931fdf9e57 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:39.070977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cb72c-e305-4775-ab19-51931fdf9e57 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:39.072535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 695/1372] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:39.078508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b7995-8437-47f4-be8f-2d4bf5f444cc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:39.078957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b7995-8437-47f4-be8f-2d4bf5f444cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:39.079367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b7995-8437-47f4-be8f-2d4bf5f444cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:39.098042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8a2b7995-8437-47f4-be8f-2d4bf5f444cc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:39.099533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8a2b7995-8437-47f4-be8f-2d4bf5f444cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:39.111071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 678/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:39.456298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6dd59-5311-4863-8ca4-fa4cd24531f5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:39.456298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6dd59-5311-4863-8ca4-fa4cd24531f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:39.456298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6dd59-5311-4863-8ca4-fa4cd24531f5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:39.459319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 696/1374] 10.222.0.48 () {54 vars in 963 bytes} [Wed Jun 29 11:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:39.462722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3cf0-81c2-4795-abfd-3524b1f18f83 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:39.463233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3cf0-81c2-4795-abfd-3524b1f18f83 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:39.463395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f3cf0-81c2-4795-abfd-3524b1f18f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:39.470646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:39.515850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2e8f3cf0-81c2-4795-abfd-3524b1f18f83 None None] MFA Rules not processed for user `adcb515e83b3484f9e93e18497fbbdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:39.517440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e8f3cf0-81c2-4795-abfd-3524b1f18f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:39.588009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 679/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Wed Jun 29 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:39.595357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6dd59-5311-4863-8ca4-fa4cd24531f5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:39.606787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6dd59-5311-4863-8ca4-fa4cd24531f5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:39.610267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689669b4-48d9-4fa8-bb4d-2173db955a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:39.611161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689669b4-48d9-4fa8-bb4d-2173db955a20 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:39.611446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689669b4-48d9-4fa8-bb4d-2173db955a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:39.611894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689669b4-48d9-4fa8-bb4d-2173db955a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:39.621400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689669b4-48d9-4fa8-bb4d-2173db955a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:39.623361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689669b4-48d9-4fa8-bb4d-2173db955a20 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:39.633197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 697/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:40.479283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fc14a-abc8-4622-88a0-5ee7d7a2fbc8 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:40.479857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fc14a-abc8-4622-88a0-5ee7d7a2fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:40.479857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fc14a-abc8-4622-88a0-5ee7d7a2fbc8 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:40.481228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 680/1377] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:40.487111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5352e0-bcca-4257-8f14-7b06f37597f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:40.487541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5352e0-bcca-4257-8f14-7b06f37597f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:40.487672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5352e0-bcca-4257-8f14-7b06f37597f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:40.507365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4b5352e0-bcca-4257-8f14-7b06f37597f5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:40.508550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4b5352e0-bcca-4257-8f14-7b06f37597f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:40.516863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 698/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:40.559912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fc14a-abc8-4622-88a0-5ee7d7a2fbc8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:40.574521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fc14a-abc8-4622-88a0-5ee7d7a2fbc8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:40.580737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837032f1-e9e0-4279-8bda-0fe6275f653e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:40.581374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837032f1-e9e0-4279-8bda-0fe6275f653e service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:40.581666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837032f1-e9e0-4279-8bda-0fe6275f653e service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:40.581946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837032f1-e9e0-4279-8bda-0fe6275f653e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:40.590897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837032f1-e9e0-4279-8bda-0fe6275f653e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:40.593117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837032f1-e9e0-4279-8bda-0fe6275f653e service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:40.602960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 681/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:42.680574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a305774-dc81-418a-a4f8-129b61dd6e81 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:42.681448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a305774-dc81-418a-a4f8-129b61dd6e81 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:42.681876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a305774-dc81-418a-a4f8-129b61dd6e81 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:42.683837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 699/1380] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:42.690234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc17d5-48a3-4a3f-bda7-44447d0928a9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:42.691056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc17d5-48a3-4a3f-bda7-44447d0928a9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:42.691516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc17d5-48a3-4a3f-bda7-44447d0928a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:42.715328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f1cc17d5-48a3-4a3f-bda7-44447d0928a9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:42.716504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f1cc17d5-48a3-4a3f-bda7-44447d0928a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:42.724573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 682/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:42.770996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a305774-dc81-418a-a4f8-129b61dd6e81 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:42.785346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a305774-dc81-418a-a4f8-129b61dd6e81 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:42.790703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5bbc8-a4d8-4e18-9fb2-0b473ec4055d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:42.791384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bbc8-a4d8-4e18-9fb2-0b473ec4055d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:42.791670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bbc8-a4d8-4e18-9fb2-0b473ec4055d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:42.791950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bbc8-a4d8-4e18-9fb2-0b473ec4055d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:42.800554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bbc8-a4d8-4e18-9fb2-0b473ec4055d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:42.802129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bbc8-a4d8-4e18-9fb2-0b473ec4055d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:42.812190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 700/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:44.889715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c9b6-8069-4e84-8402-4d02aec9568d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:44.890224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c9b6-8069-4e84-8402-4d02aec9568d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:44.890502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c9b6-8069-4e84-8402-4d02aec9568d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:44.892024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 683/1383] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:44.897316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645162-642a-4b64-8554-a857e71d883f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:44.897740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645162-642a-4b64-8554-a857e71d883f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:44.897883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d645162-642a-4b64-8554-a857e71d883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:44.917045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5d645162-642a-4b64-8554-a857e71d883f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:44.918498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5d645162-642a-4b64-8554-a857e71d883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:44.927751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 701/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:44.969405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c9b6-8069-4e84-8402-4d02aec9568d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:44.984736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c9b6-8069-4e84-8402-4d02aec9568d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:44.992605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace1653-0e78-4832-95ef-e4e3cd8afd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:44.993267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1653-0e78-4832-95ef-e4e3cd8afd4c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:44.993559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1653-0e78-4832-95ef-e4e3cd8afd4c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:44.993828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace1653-0e78-4832-95ef-e4e3cd8afd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:45.006606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace1653-0e78-4832-95ef-e4e3cd8afd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:45.008217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace1653-0e78-4832-95ef-e4e3cd8afd4c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:45.020550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 684/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:47.071523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c33f-094e-40b7-a1ab-c3978163f1df None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:47.072038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c33f-094e-40b7-a1ab-c3978163f1df None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:47.072038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c33f-094e-40b7-a1ab-c3978163f1df None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:47.073410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 702/1386] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:47.082327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005008-4d24-45bb-b13c-c6155ebb9f16 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:47.082756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005008-4d24-45bb-b13c-c6155ebb9f16 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:47.082983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005008-4d24-45bb-b13c-c6155ebb9f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:47.109341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-49005008-4d24-45bb-b13c-c6155ebb9f16 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:47.110605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-49005008-4d24-45bb-b13c-c6155ebb9f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:47.119826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 685/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:47.164868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c33f-094e-40b7-a1ab-c3978163f1df None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:47.180653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c33f-094e-40b7-a1ab-c3978163f1df None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:47.187877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64c0cd-161b-4109-a241-4b495c16d811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:47.188542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64c0cd-161b-4109-a241-4b495c16d811 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:47.188829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64c0cd-161b-4109-a241-4b495c16d811 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:47.189114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64c0cd-161b-4109-a241-4b495c16d811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:47.198239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64c0cd-161b-4109-a241-4b495c16d811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:47.200292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64c0cd-161b-4109-a241-4b495c16d811 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:47.210835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 703/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:49.543625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294f2f-0555-4876-afbb-d2488f5c2620 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:49.544169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294f2f-0555-4876-afbb-d2488f5c2620 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:49.544169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294f2f-0555-4876-afbb-d2488f5c2620 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:49.545560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 686/1389] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:49.551545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013479c-1224-4f35-9f4b-08d5553669c2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:49.551965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013479c-1224-4f35-9f4b-08d5553669c2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:49.552213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013479c-1224-4f35-9f4b-08d5553669c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:49.572828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0013479c-1224-4f35-9f4b-08d5553669c2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:49.574257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0013479c-1224-4f35-9f4b-08d5553669c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:49.583693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 704/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:49.637458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294f2f-0555-4876-afbb-d2488f5c2620 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:49.657392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294f2f-0555-4876-afbb-d2488f5c2620 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:49.664427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b5b17a-a651-4b01-93d1-09cbacaa96e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:49.665220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5b17a-a651-4b01-93d1-09cbacaa96e9 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:49.665581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5b17a-a651-4b01-93d1-09cbacaa96e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:49.665927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b5b17a-a651-4b01-93d1-09cbacaa96e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:49.676425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5b17a-a651-4b01-93d1-09cbacaa96e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:49.678425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b5b17a-a651-4b01-93d1-09cbacaa96e9 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:49.690753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 687/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:52.308386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0544-306f-4927-84ce-bf25a309213f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:52.308915 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0544-306f-4927-84ce-bf25a309213f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:52.308915 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0544-306f-4927-84ce-bf25a309213f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:52.310805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 705/1392] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:52.317062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1789e-953f-4e7d-91d1-afefb90f727c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:52.317623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1789e-953f-4e7d-91d1-afefb90f727c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:52.317731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1789e-953f-4e7d-91d1-afefb90f727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:52.338627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7fb1789e-953f-4e7d-91d1-afefb90f727c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:52.340143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7fb1789e-953f-4e7d-91d1-afefb90f727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:52.350037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 688/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:52.402464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0544-306f-4927-84ce-bf25a309213f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:52.419868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0544-306f-4927-84ce-bf25a309213f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:52.425829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a09d7-070e-4e64-9a8f-d3b6c0d422c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:52.426485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a09d7-070e-4e64-9a8f-d3b6c0d422c0 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:52.426771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a09d7-070e-4e64-9a8f-d3b6c0d422c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:52.427069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a09d7-070e-4e64-9a8f-d3b6c0d422c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:52.436578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a09d7-070e-4e64-9a8f-d3b6c0d422c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:52.438160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a09d7-070e-4e64-9a8f-d3b6c0d422c0 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:52.448013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 706/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:54.523330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3608-f1ca-4770-b19e-9d3d1e9f9a62 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.523920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3608-f1ca-4770-b19e-9d3d1e9f9a62 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.523920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe3608-f1ca-4770-b19e-9d3d1e9f9a62 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:54.525276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 689/1395] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:54.531359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9632f-5915-48ab-b96e-4bb63ed8ab0c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.531768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9632f-5915-48ab-b96e-4bb63ed8ab0c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.531930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9632f-5915-48ab-b96e-4bb63ed8ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:54.549903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-68b9632f-5915-48ab-b96e-4bb63ed8ab0c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:54.551115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-68b9632f-5915-48ab-b96e-4bb63ed8ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:54.559200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 707/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:54.603222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3608-f1ca-4770-b19e-9d3d1e9f9a62 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:54.618150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe3608-f1ca-4770-b19e-9d3d1e9f9a62 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:54.623499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894bd4a-b648-4993-91f3-dd56d2bd5f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:54.624147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bd4a-b648-4993-91f3-dd56d2bd5f3c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.624436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bd4a-b648-4993-91f3-dd56d2bd5f3c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.624719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bd4a-b648-4993-91f3-dd56d2bd5f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:54.633104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894bd4a-b648-4993-91f3-dd56d2bd5f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:54.634696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a894bd4a-b648-4993-91f3-dd56d2bd5f3c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:54.644146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 690/1397] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:54.871856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a16823-ff79-4a7b-ae3a-6700e99a064c None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.872182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a16823-ff79-4a7b-ae3a-6700e99a064c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.872471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a16823-ff79-4a7b-ae3a-6700e99a064c None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:54.873900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 708/1398] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:54.879452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7188c9-111b-4355-a96a-71689dfe5776 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.879745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7188c9-111b-4355-a96a-71689dfe5776 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.880027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7188c9-111b-4355-a96a-71689dfe5776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:54.898217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7a7188c9-111b-4355-a96a-71689dfe5776 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:54.899414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7a7188c9-111b-4355-a96a-71689dfe5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:54.907771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 691/1399] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:54.962671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8042e-fb48-4e76-916f-4e726ec8346f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.963059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8042e-fb48-4e76-916f-4e726ec8346f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.963417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8042e-fb48-4e76-916f-4e726ec8346f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:54.964858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 709/1400] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jun 29 11:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:54.970502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16bf7-79ba-4204-8b8d-c39223cf2199 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:54.970795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16bf7-79ba-4204-8b8d-c39223cf2199 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:54.971109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b16bf7-79ba-4204-8b8d-c39223cf2199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:55.030696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-95b16bf7-79ba-4204-8b8d-c39223cf2199 None None] MFA Rules not processed for user `012fd3c15c444f5a8519f1b44fbcd5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:55.031933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-95b16bf7-79ba-4204-8b8d-c39223cf2199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:55.063671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:55.093343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 692/1401] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jun 29 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:55.101150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8042e-fb48-4e76-916f-4e726ec8346f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:55.112052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8042e-fb48-4e76-916f-4e726ec8346f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:55.115628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd728a3-3dea-4331-982e-cf381d607029 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:55.116363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd728a3-3dea-4331-982e-cf381d607029 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:55.116719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd728a3-3dea-4331-982e-cf381d607029 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:55.117075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd728a3-3dea-4331-982e-cf381d607029 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:55.126827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd728a3-3dea-4331-982e-cf381d607029 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:55.128241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd728a3-3dea-4331-982e-cf381d607029 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:55.138398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 710/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:10:55.838885 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd576c0-7ffc-4c8c-b686-81c45c1ec2ba None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:55.839414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd576c0-7ffc-4c8c-b686-81c45c1ec2ba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:55.839513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd576c0-7ffc-4c8c-b686-81c45c1ec2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:55.886927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-efd576c0-7ffc-4c8c-b686-81c45c1ec2ba None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:55.888238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-efd576c0-7ffc-4c8c-b686-81c45c1ec2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:55.950363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 693/1403] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:56.001629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ee60-c12d-4902-85be-67dc6f7f01e5 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:56.002104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ee60-c12d-4902-85be-67dc6f7f01e5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:56.002320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ee60-c12d-4902-85be-67dc6f7f01e5 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:56.003801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 711/1404] 10.222.0.48 () {54 vars in 942 bytes} [Wed Jun 29 11:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:56.010011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432144-e517-43b7-a8c4-ae97071dcf30 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:56.010310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432144-e517-43b7-a8c4-ae97071dcf30 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:56.010591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432144-e517-43b7-a8c4-ae97071dcf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:56.059981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dd432144-e517-43b7-a8c4-ae97071dcf30 None None] MFA Rules not processed for user `45862644baba4528bd6dbe4dab092089`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:56.061105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dd432144-e517-43b7-a8c4-ae97071dcf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:56.131996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 694/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Wed Jun 29 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:56.141474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ee60-c12d-4902-85be-67dc6f7f01e5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:56.155602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0ee60-c12d-4902-85be-67dc6f7f01e5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:56.160799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dd799-badd-4c5c-b40a-641cd7feedb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:56.161510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd799-badd-4c5c-b40a-641cd7feedb5 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:56.161801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd799-badd-4c5c-b40a-641cd7feedb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:56.162078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dd799-badd-4c5c-b40a-641cd7feedb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:56.170770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dd799-badd-4c5c-b40a-641cd7feedb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:56.172416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dd799-badd-4c5c-b40a-641cd7feedb5 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:56.180720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 712/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:10:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:10:56.743388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665dcdd-1d99-4436-bb0f-ef555e82bd73 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:56.744156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665dcdd-1d99-4436-bb0f-ef555e82bd73 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:56.744426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665dcdd-1d99-4436-bb0f-ef555e82bd73 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:56.746094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 695/1407] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:10:56.751757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124449d9-4c45-490c-b873-131bd0d636f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:56.752129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124449d9-4c45-490c-b873-131bd0d636f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:56.752484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124449d9-4c45-490c-b873-131bd0d636f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:56.758827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=67 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:56.772948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-124449d9-4c45-490c-b873-131bd0d636f5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:10:56.774255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-124449d9-4c45-490c-b873-131bd0d636f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:10:56.782649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 713/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:10:56.827896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665dcdd-1d99-4436-bb0f-ef555e82bd73 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:10:56.843496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665dcdd-1d99-4436-bb0f-ef555e82bd73 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:10:56.848997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e13764-2270-4b76-91ab-116e3627338e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:10:56.849643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e13764-2270-4b76-91ab-116e3627338e service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:10:56.849932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e13764-2270-4b76-91ab-116e3627338e service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:10:56.850212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e13764-2270-4b76-91ab-116e3627338e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:10:56.859445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e13764-2270-4b76-91ab-116e3627338e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:10:56.861031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e13764-2270-4b76-91ab-116e3627338e service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:10:56.866045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:10:56.872715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 696/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:06.767253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:11:18.454012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f2068-f471-4573-9765-b84e5cdb8b50 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:18.454689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f2068-f471-4573-9765-b84e5cdb8b50 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:18.454689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f2068-f471-4573-9765-b84e5cdb8b50 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:18.455954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 714/1410] 10.222.0.48 () {54 vars in 918 bytes} [Wed Jun 29 11:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:18.460940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0bdf0-3cee-41df-88f0-2bdfa002b0e0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:18.461346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0bdf0-3cee-41df-88f0-2bdfa002b0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:18.461516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0bdf0-3cee-41df-88f0-2bdfa002b0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:18.479524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-62a0bdf0-3cee-41df-88f0-2bdfa002b0e0 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:18.480754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62a0bdf0-3cee-41df-88f0-2bdfa002b0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:18.489769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 697/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jun 29 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:18.503317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036465b-c745-4594-b18b-30979b9032a7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:18.503612 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036465b-c745-4594-b18b-30979b9032a7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:18.503928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036465b-c745-4594-b18b-30979b9032a7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:18.505264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 715/1412] 10.222.0.48 () {54 vars in 918 bytes} [Wed Jun 29 11:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:18.509579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c917bb-d9f4-487f-b208-7f6630f2a4d3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:18.509894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c917bb-d9f4-487f-b208-7f6630f2a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:18.510177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c917bb-d9f4-487f-b208-7f6630f2a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:18.527348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-93c917bb-d9f4-487f-b208-7f6630f2a4d3 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:18.529049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-93c917bb-d9f4-487f-b208-7f6630f2a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:18.538074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 698/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jun 29 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:21.013801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ed75-b563-4899-9f29-101bcb5481ed None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:21.014226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ed75-b563-4899-9f29-101bcb5481ed None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:21.014368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36ed75-b563-4899-9f29-101bcb5481ed None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:21.015784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:21.021122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eac1-8ae7-4bcb-be8c-7b60d6884a9a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:21.021582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eac1-8ae7-4bcb-be8c-7b60d6884a9a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:21.021701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73eac1-8ae7-4bcb-be8c-7b60d6884a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:21.039709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fc73eac1-8ae7-4bcb-be8c-7b60d6884a9a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:21.040884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc73eac1-8ae7-4bcb-be8c-7b60d6884a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:21.049144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:21.098448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ed75-b563-4899-9f29-101bcb5481ed None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:21.114650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36ed75-b563-4899-9f29-101bcb5481ed None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:21.120382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8469f-fae9-4582-b1e5-fe0199ed0a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:21.121030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8469f-fae9-4582-b1e5-fe0199ed0a19 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:21.121967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8469f-fae9-4582-b1e5-fe0199ed0a19 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:21.122249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8469f-fae9-4582-b1e5-fe0199ed0a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:21.131267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8469f-fae9-4582-b1e5-fe0199ed0a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:21.132890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8469f-fae9-4582-b1e5-fe0199ed0a19 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:21.142309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 717/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:22.059923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd23745-2dbc-4385-958c-5b20d77fafdd None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:22.060696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd23745-2dbc-4385-958c-5b20d77fafdd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:22.060696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd23745-2dbc-4385-958c-5b20d77fafdd None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:22.061935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:22.066968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429b0e-f279-43dc-9930-ad9e9805a612 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:22.067412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429b0e-f279-43dc-9930-ad9e9805a612 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:22.067559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88429b0e-f279-43dc-9930-ad9e9805a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:22.085288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-88429b0e-f279-43dc-9930-ad9e9805a612 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:22.086475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-88429b0e-f279-43dc-9930-ad9e9805a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:22.094881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:22.248679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd23745-2dbc-4385-958c-5b20d77fafdd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:22.262677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd23745-2dbc-4385-958c-5b20d77fafdd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:22.268276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a193c1f-1b70-41d6-9dfc-9ecf4a494b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:22.268910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a193c1f-1b70-41d6-9dfc-9ecf4a494b77 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:22.269195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a193c1f-1b70-41d6-9dfc-9ecf4a494b77 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:22.269473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a193c1f-1b70-41d6-9dfc-9ecf4a494b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:22.278064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a193c1f-1b70-41d6-9dfc-9ecf4a494b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:22.279668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a193c1f-1b70-41d6-9dfc-9ecf4a494b77 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:22.288798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 701/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:23.174976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242a0b-3f8f-406f-9b7c-d8699dfa1d01 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:23.175529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242a0b-3f8f-406f-9b7c-d8699dfa1d01 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:23.175658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4242a0b-3f8f-406f-9b7c-d8699dfa1d01 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:23.176954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:23.182142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad9fb8-3b05-41de-baab-8fc961c763db None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:23.182588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad9fb8-3b05-41de-baab-8fc961c763db None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:23.182724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad9fb8-3b05-41de-baab-8fc961c763db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:23.201381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5bad9fb8-3b05-41de-baab-8fc961c763db None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:23.202551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5bad9fb8-3b05-41de-baab-8fc961c763db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:23.210133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:23.361721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242a0b-3f8f-406f-9b7c-d8699dfa1d01 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:23.376661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4242a0b-3f8f-406f-9b7c-d8699dfa1d01 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:23.382030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87978-76ad-4ae4-9b90-af48d67b9590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:23.382670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87978-76ad-4ae4-9b90-af48d67b9590 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:23.382960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87978-76ad-4ae4-9b90-af48d67b9590 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:23.383275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87978-76ad-4ae4-9b90-af48d67b9590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:23.391348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87978-76ad-4ae4-9b90-af48d67b9590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:23.392919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87978-76ad-4ae4-9b90-af48d67b9590 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:23.402151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 720/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:24.251923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648466bf-cd5c-4cdc-99e1-74e6a41b7deb None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:24.252432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648466bf-cd5c-4cdc-99e1-74e6a41b7deb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:24.252432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648466bf-cd5c-4cdc-99e1-74e6a41b7deb None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:24.253800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:24.258706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8950-dcc4-480d-ac38-193db97e7c76 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:24.259145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8950-dcc4-480d-ac38-193db97e7c76 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:24.259317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd8950-dcc4-480d-ac38-193db97e7c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:24.276887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5cdd8950-dcc4-480d-ac38-193db97e7c76 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:24.278077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5cdd8950-dcc4-480d-ac38-193db97e7c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:24.285794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:24.433989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648466bf-cd5c-4cdc-99e1-74e6a41b7deb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:24.448302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648466bf-cd5c-4cdc-99e1-74e6a41b7deb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:24.453646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3be06-a340-46eb-b839-49f972701c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:24.454274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3be06-a340-46eb-b839-49f972701c57 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:24.454558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3be06-a340-46eb-b839-49f972701c57 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:24.454835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3be06-a340-46eb-b839-49f972701c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:24.462770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3be06-a340-46eb-b839-49f972701c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:24.464376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3be06-a340-46eb-b839-49f972701c57 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:24.473977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 704/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:25.328507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80fe0-3a3d-4260-88d7-f92cdf607716 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:25.329061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80fe0-3a3d-4260-88d7-f92cdf607716 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:25.329061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe80fe0-3a3d-4260-88d7-f92cdf607716 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:25.330499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:25.335387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb08ea-46fd-4b4c-ae25-b43572890822 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:25.335773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb08ea-46fd-4b4c-ae25-b43572890822 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:25.335940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb08ea-46fd-4b4c-ae25-b43572890822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:25.353705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1ffb08ea-46fd-4b4c-ae25-b43572890822 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:25.354876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1ffb08ea-46fd-4b4c-ae25-b43572890822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:25.362574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:25.512138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80fe0-3a3d-4260-88d7-f92cdf607716 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:25.526357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe80fe0-3a3d-4260-88d7-f92cdf607716 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:25.531740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf381c9-8365-43d9-80c3-7d5025462c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:25.532378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf381c9-8365-43d9-80c3-7d5025462c36 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:25.532668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf381c9-8365-43d9-80c3-7d5025462c36 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:25.532953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf381c9-8365-43d9-80c3-7d5025462c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:25.540948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf381c9-8365-43d9-80c3-7d5025462c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:25.542524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf381c9-8365-43d9-80c3-7d5025462c36 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:25.552326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 723/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:26.367611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950c03-e33b-4a3c-8294-ec01cf1a8b14 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:26.368159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950c03-e33b-4a3c-8294-ec01cf1a8b14 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:26.368159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee950c03-e33b-4a3c-8294-ec01cf1a8b14 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:26.369542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:26.374467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7b8d-4ee2-458f-aa20-6bd895a3d7f4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:26.374886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7b8d-4ee2-458f-aa20-6bd895a3d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:26.375050 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa7b8d-4ee2-458f-aa20-6bd895a3d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:26.393555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3faa7b8d-4ee2-458f-aa20-6bd895a3d7f4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:26.394737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3faa7b8d-4ee2-458f-aa20-6bd895a3d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:26.403226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:26.552630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee950c03-e33b-4a3c-8294-ec01cf1a8b14 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:26.567306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee950c03-e33b-4a3c-8294-ec01cf1a8b14 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:26.572665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bac60-87e7-4871-bc39-d30031f96ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:26.573298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bac60-87e7-4871-bc39-d30031f96ad1 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:26.573587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bac60-87e7-4871-bc39-d30031f96ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:26.573871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bac60-87e7-4871-bc39-d30031f96ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:26.582574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bac60-87e7-4871-bc39-d30031f96ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:26.584197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bac60-87e7-4871-bc39-d30031f96ad1 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:26.594211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 707/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:27.396302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09ec8-0f51-4e77-9aa8-b4438c86815e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:27.396842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09ec8-0f51-4e77-9aa8-b4438c86815e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:27.396953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09ec8-0f51-4e77-9aa8-b4438c86815e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:27.398255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:27.403824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7c506-da63-4a01-aa9b-5beb2dceb1a2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:27.404382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7c506-da63-4a01-aa9b-5beb2dceb1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:27.404382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7c506-da63-4a01-aa9b-5beb2dceb1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:27.422643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-35c7c506-da63-4a01-aa9b-5beb2dceb1a2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:27.423867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-35c7c506-da63-4a01-aa9b-5beb2dceb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:27.431927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:27.580315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd09ec8-0f51-4e77-9aa8-b4438c86815e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:27.594913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd09ec8-0f51-4e77-9aa8-b4438c86815e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:27.600368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4cb8-6635-42ce-b887-fc7abfd2741d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:27.601001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4cb8-6635-42ce-b887-fc7abfd2741d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:27.601288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4cb8-6635-42ce-b887-fc7abfd2741d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:27.601569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4cb8-6635-42ce-b887-fc7abfd2741d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:27.610182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4cb8-6635-42ce-b887-fc7abfd2741d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:27.611788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4cb8-6635-42ce-b887-fc7abfd2741d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:27.621034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 726/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:28.417195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1593de7-af78-45df-aa8b-a8fadcc95223 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:28.417766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1593de7-af78-45df-aa8b-a8fadcc95223 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:28.417766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1593de7-af78-45df-aa8b-a8fadcc95223 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:28.419827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:28.424578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5fee-9b0d-473f-a8f3-2df744e1c6fd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:28.425018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5fee-9b0d-473f-a8f3-2df744e1c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:28.425132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d5fee-9b0d-473f-a8f3-2df744e1c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:28.442952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2c9d5fee-9b0d-473f-a8f3-2df744e1c6fd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:28.444149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2c9d5fee-9b0d-473f-a8f3-2df744e1c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:28.451827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:28.601021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1593de7-af78-45df-aa8b-a8fadcc95223 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:28.614954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1593de7-af78-45df-aa8b-a8fadcc95223 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:28.620350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddff6d5-fa8e-4556-8023-f15d2fc77985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:28.620977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff6d5-fa8e-4556-8023-f15d2fc77985 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:28.621284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff6d5-fa8e-4556-8023-f15d2fc77985 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:28.621562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddff6d5-fa8e-4556-8023-f15d2fc77985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:28.629462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddff6d5-fa8e-4556-8023-f15d2fc77985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:28.631031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddff6d5-fa8e-4556-8023-f15d2fc77985 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:28.640946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 710/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:29.444959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33906-41cb-473c-9095-482d917329a4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:29.445527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33906-41cb-473c-9095-482d917329a4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:29.445527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33906-41cb-473c-9095-482d917329a4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:29.446893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:29.451874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17e503-bf1f-4500-a466-e71446fa1b30 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:29.452305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17e503-bf1f-4500-a466-e71446fa1b30 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:29.452449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17e503-bf1f-4500-a466-e71446fa1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:29.470033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5c17e503-bf1f-4500-a466-e71446fa1b30 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:29.471249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5c17e503-bf1f-4500-a466-e71446fa1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:29.478877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:29.631488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33906-41cb-473c-9095-482d917329a4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:29.645697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33906-41cb-473c-9095-482d917329a4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:29.651088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc460e-4cea-4370-848f-99764f5a4286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:29.651751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc460e-4cea-4370-848f-99764f5a4286 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:29.652044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc460e-4cea-4370-848f-99764f5a4286 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:29.652831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc460e-4cea-4370-848f-99764f5a4286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:29.660860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc460e-4cea-4370-848f-99764f5a4286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:29.662429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc460e-4cea-4370-848f-99764f5a4286 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:29.672384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 729/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:31.619154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baca60-3f03-476b-b2e1-a6fb894fe529 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:31.619745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baca60-3f03-476b-b2e1-a6fb894fe529 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:31.619745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41baca60-3f03-476b-b2e1-a6fb894fe529 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:31.621113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:31.626550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084e1d5-a932-473e-979d-9e84ea0bfcfd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:31.626961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084e1d5-a932-473e-979d-9e84ea0bfcfd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:31.627157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084e1d5-a932-473e-979d-9e84ea0bfcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:31.644893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4084e1d5-a932-473e-979d-9e84ea0bfcfd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:31.646094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4084e1d5-a932-473e-979d-9e84ea0bfcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:31.654392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:31.691575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41baca60-3f03-476b-b2e1-a6fb894fe529 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:31.702788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41baca60-3f03-476b-b2e1-a6fb894fe529 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:31.706421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60a419-e0f6-421a-b5ea-a923786d3997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:31.707066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a419-e0f6-421a-b5ea-a923786d3997 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:31.707367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a419-e0f6-421a-b5ea-a923786d3997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:31.707648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60a419-e0f6-421a-b5ea-a923786d3997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:31.717053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60a419-e0f6-421a-b5ea-a923786d3997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:31.718479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60a419-e0f6-421a-b5ea-a923786d3997 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:31.727721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 713/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:33.910511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d351b-ba25-49ee-8655-816ce0e20b82 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:33.911115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d351b-ba25-49ee-8655-816ce0e20b82 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:33.911115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d351b-ba25-49ee-8655-816ce0e20b82 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:33.912471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:33.917616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8ddee-b0e8-43a3-be26-8b98e337d553 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:33.918014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8ddee-b0e8-43a3-be26-8b98e337d553 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:33.918214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8ddee-b0e8-43a3-be26-8b98e337d553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:33.935782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-72f8ddee-b0e8-43a3-be26-8b98e337d553 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:33.936963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-72f8ddee-b0e8-43a3-be26-8b98e337d553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:33.944665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:33.982617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d351b-ba25-49ee-8655-816ce0e20b82 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:33.993281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d351b-ba25-49ee-8655-816ce0e20b82 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:33.996757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c604de4-a2f8-4a05-8dce-cc992e70e6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:33.997393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604de4-a2f8-4a05-8dce-cc992e70e6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:33.997706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604de4-a2f8-4a05-8dce-cc992e70e6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:33.997982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c604de4-a2f8-4a05-8dce-cc992e70e6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:34.006866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604de4-a2f8-4a05-8dce-cc992e70e6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:34.008310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c604de4-a2f8-4a05-8dce-cc992e70e6b8 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:34.018259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 732/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:36.333814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42274c-ce59-423b-a4c3-87a24194f226 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:36.334365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42274c-ce59-423b-a4c3-87a24194f226 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:36.334365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42274c-ce59-423b-a4c3-87a24194f226 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:36.335827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:36.341476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c186cf0-3fca-4223-8fa1-9981fc40dc4e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:36.341877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c186cf0-3fca-4223-8fa1-9981fc40dc4e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:36.342034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c186cf0-3fca-4223-8fa1-9981fc40dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:36.359776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3c186cf0-3fca-4223-8fa1-9981fc40dc4e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:36.360951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c186cf0-3fca-4223-8fa1-9981fc40dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:36.368566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:36.406755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42274c-ce59-423b-a4c3-87a24194f226 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:36.417390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42274c-ce59-423b-a4c3-87a24194f226 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:36.421623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268edb5-c197-4cde-bbb1-76808acbb5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:36.422248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268edb5-c197-4cde-bbb1-76808acbb5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:36.422532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268edb5-c197-4cde-bbb1-76808acbb5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:36.422809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268edb5-c197-4cde-bbb1-76808acbb5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:36.431959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268edb5-c197-4cde-bbb1-76808acbb5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:36.433404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268edb5-c197-4cde-bbb1-76808acbb5a3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:36.442678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 716/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:38.599494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8365-3466-4f5c-a09d-ed665835bf11 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:38.600042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8365-3466-4f5c-a09d-ed665835bf11 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:38.600042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb8365-3466-4f5c-a09d-ed665835bf11 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:38.601465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:38.606765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55438-4ff3-4a91-90f0-662a413028ac None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:38.607228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55438-4ff3-4a91-90f0-662a413028ac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:38.607378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e55438-4ff3-4a91-90f0-662a413028ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:38.625361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b6e55438-4ff3-4a91-90f0-662a413028ac None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:38.626557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b6e55438-4ff3-4a91-90f0-662a413028ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:38.634335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:38.672131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8365-3466-4f5c-a09d-ed665835bf11 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:38.683021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb8365-3466-4f5c-a09d-ed665835bf11 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:38.687003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab71186-bfe7-4047-8e56-78069756175a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:38.687661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab71186-bfe7-4047-8e56-78069756175a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:38.687950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab71186-bfe7-4047-8e56-78069756175a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:38.688231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab71186-bfe7-4047-8e56-78069756175a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:38.697066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab71186-bfe7-4047-8e56-78069756175a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:38.698486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab71186-bfe7-4047-8e56-78069756175a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:38.708346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 735/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:40.754465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adec74-1dc9-415b-8334-af9b569a9f1b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:40.754996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adec74-1dc9-415b-8334-af9b569a9f1b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:40.754996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adec74-1dc9-415b-8334-af9b569a9f1b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:40.756380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:40.761792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1573b2-cd0a-4f6b-8441-37fce5db6b3d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:40.762218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1573b2-cd0a-4f6b-8441-37fce5db6b3d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:40.762356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1573b2-cd0a-4f6b-8441-37fce5db6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:40.779544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1d1573b2-cd0a-4f6b-8441-37fce5db6b3d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:40.780761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1d1573b2-cd0a-4f6b-8441-37fce5db6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:40.788463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:40.827530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adec74-1dc9-415b-8334-af9b569a9f1b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:40.840112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adec74-1dc9-415b-8334-af9b569a9f1b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:40.843536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bc2b8-1961-4b8e-a646-374c30412724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:40.844199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bc2b8-1961-4b8e-a646-374c30412724 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:40.844479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bc2b8-1961-4b8e-a646-374c30412724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:40.844753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bc2b8-1961-4b8e-a646-374c30412724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:40.853783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bc2b8-1961-4b8e-a646-374c30412724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:40.855900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bc2b8-1961-4b8e-a646-374c30412724 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:40.865281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 719/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:42.945202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9510-5193-4bbf-8440-4354afe0d790 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:42.945722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9510-5193-4bbf-8440-4354afe0d790 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:42.945722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e9510-5193-4bbf-8440-4354afe0d790 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:42.947067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:42.952339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae49b-2d9d-4b92-a496-483bce6134fe None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:42.952733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae49b-2d9d-4b92-a496-483bce6134fe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:42.952901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae49b-2d9d-4b92-a496-483bce6134fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:42.970230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-186ae49b-2d9d-4b92-a496-483bce6134fe None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:42.971499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-186ae49b-2d9d-4b92-a496-483bce6134fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:42.979277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:43.017325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e9510-5193-4bbf-8440-4354afe0d790 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:43.028148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e9510-5193-4bbf-8440-4354afe0d790 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:43.031570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bebbfc-d311-4b8b-9362-45f5f1165146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:43.032204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebbfc-d311-4b8b-9362-45f5f1165146 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:43.032491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebbfc-d311-4b8b-9362-45f5f1165146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:43.032768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bebbfc-d311-4b8b-9362-45f5f1165146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:43.041526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bebbfc-d311-4b8b-9362-45f5f1165146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:43.043490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bebbfc-d311-4b8b-9362-45f5f1165146 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:43.052736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 738/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:45.117514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb32a26-4857-4577-96a8-050438067437 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:45.118030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb32a26-4857-4577-96a8-050438067437 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:45.118169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb32a26-4857-4577-96a8-050438067437 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:45.119502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:45.125339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514228c-5a38-47b8-8661-37a1653d2143 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:45.125747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514228c-5a38-47b8-8661-37a1653d2143 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:45.125912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514228c-5a38-47b8-8661-37a1653d2143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:45.144906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0514228c-5a38-47b8-8661-37a1653d2143 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:45.146214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0514228c-5a38-47b8-8661-37a1653d2143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:45.154254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:45.192191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb32a26-4857-4577-96a8-050438067437 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:45.202858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb32a26-4857-4577-96a8-050438067437 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:45.206360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32168c09-09a1-47fc-957b-009337f60f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:45.206988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32168c09-09a1-47fc-957b-009337f60f3e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:45.207307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32168c09-09a1-47fc-957b-009337f60f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:45.207587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32168c09-09a1-47fc-957b-009337f60f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:45.216349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32168c09-09a1-47fc-957b-009337f60f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:45.217798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32168c09-09a1-47fc-957b-009337f60f3e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:45.226940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 722/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:47.396407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2d67-8bf3-4c94-bec3-49edffe8193f None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:47.396971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2d67-8bf3-4c94-bec3-49edffe8193f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:47.396971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae2d67-8bf3-4c94-bec3-49edffe8193f None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:47.398484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:47.403733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eba863-1a81-469e-b456-5df32c213ac5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:47.404178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eba863-1a81-469e-b456-5df32c213ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:47.404284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eba863-1a81-469e-b456-5df32c213ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:47.410311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=79 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:11:47.423959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c0eba863-1a81-469e-b456-5df32c213ac5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:47.425155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c0eba863-1a81-469e-b456-5df32c213ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:47.433772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:47.470296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae2d67-8bf3-4c94-bec3-49edffe8193f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:47.475608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=73 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:11:47.482322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae2d67-8bf3-4c94-bec3-49edffe8193f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:47.485976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f813e8-002d-4cd2-aa3d-c5f272c9394a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:47.486616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f813e8-002d-4cd2-aa3d-c5f272c9394a service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:47.486900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f813e8-002d-4cd2-aa3d-c5f272c9394a service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:47.487226 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f813e8-002d-4cd2-aa3d-c5f272c9394a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:47.496683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f813e8-002d-4cd2-aa3d-c5f272c9394a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:47.498109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f813e8-002d-4cd2-aa3d-c5f272c9394a service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:47.507378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 741/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:49.549856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817dd39-2ca6-4ec5-910b-8fb63ae20fd7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:49.550461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817dd39-2ca6-4ec5-910b-8fb63ae20fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:49.550461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817dd39-2ca6-4ec5-910b-8fb63ae20fd7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:49.551836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:49.557295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ae39-b31e-423f-ba8c-aa1c52e45804 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:49.557741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ae39-b31e-423f-ba8c-aa1c52e45804 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:49.557850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119ae39-b31e-423f-ba8c-aa1c52e45804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:49.575701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e119ae39-b31e-423f-ba8c-aa1c52e45804 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:49.576896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e119ae39-b31e-423f-ba8c-aa1c52e45804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:49.584535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:49.620195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817dd39-2ca6-4ec5-910b-8fb63ae20fd7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:49.631237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817dd39-2ca6-4ec5-910b-8fb63ae20fd7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:49.634673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaab130-f0f9-4629-a4b8-c594ae557a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:49.635340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaab130-f0f9-4629-a4b8-c594ae557a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:49.635630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaab130-f0f9-4629-a4b8-c594ae557a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:49.635910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaab130-f0f9-4629-a4b8-c594ae557a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:49.644670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaab130-f0f9-4629-a4b8-c594ae557a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:49.646100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaab130-f0f9-4629-a4b8-c594ae557a86 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:49.655509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 725/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:11:51.684884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141c2d-32ce-4c4c-914d-e55d1dc93308 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:51.685443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141c2d-32ce-4c4c-914d-e55d1dc93308 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:51.685443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa141c2d-32ce-4c4c-914d-e55d1dc93308 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:51.686811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:11:51.691850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e8de6-2ddf-4522-a8bb-5fb75dc6c5d4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:51.692257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e8de6-2ddf-4522-a8bb-5fb75dc6c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:51.692410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e8de6-2ddf-4522-a8bb-5fb75dc6c5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:51.709971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e60e8de6-2ddf-4522-a8bb-5fb75dc6c5d4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:11:51.711183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e60e8de6-2ddf-4522-a8bb-5fb75dc6c5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:11:51.719356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:11:51.755234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141c2d-32ce-4c4c-914d-e55d1dc93308 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:11:51.766638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa141c2d-32ce-4c4c-914d-e55d1dc93308 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:11:51.770143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43f6cd-4753-469a-8953-06b47c860dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:11:51.770779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43f6cd-4753-469a-8953-06b47c860dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:11:51.771093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43f6cd-4753-469a-8953-06b47c860dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:11:51.771375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43f6cd-4753-469a-8953-06b47c860dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:11:51.780882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43f6cd-4753-469a-8953-06b47c860dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:11:51.782333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43f6cd-4753-469a-8953-06b47c860dc6 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:11:51.791735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 744/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:01.704842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=11 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:12:01.787553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=14 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:12:11.521774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853029f4-fe3e-47a8-9754-a0c2f301165c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:11.522358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853029f4-fe3e-47a8-9754-a0c2f301165c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:11.522358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853029f4-fe3e-47a8-9754-a0c2f301165c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:11.523730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 727/1471] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:11.529818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238223c-2ffc-4191-9aa2-9658c2352263 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:11.530269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238223c-2ffc-4191-9aa2-9658c2352263 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:11.530387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238223c-2ffc-4191-9aa2-9658c2352263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:11.547750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0238223c-2ffc-4191-9aa2-9658c2352263 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:11.548950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0238223c-2ffc-4191-9aa2-9658c2352263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:11.557005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 745/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:11.605104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631d4f-6a37-4cd1-953a-ee17d7b04d05 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:11.605462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631d4f-6a37-4cd1-953a-ee17d7b04d05 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:11.605805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31631d4f-6a37-4cd1-953a-ee17d7b04d05 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:11.607221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 728/1473] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jun 29 11:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:11.612098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f7ce-65c0-4c93-973f-aa8c92e23999 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:11.612396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f7ce-65c0-4c93-973f-aa8c92e23999 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:11.612681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f7ce-65c0-4c93-973f-aa8c92e23999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:11.630843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3516f7ce-65c0-4c93-973f-aa8c92e23999 None None] MFA Rules not processed for user `012fd3c15c444f5a8519f1b44fbcd5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:11.632059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3516f7ce-65c0-4c93-973f-aa8c92e23999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:11.639104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 746/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jun 29 11:12:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:11.646184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31631d4f-6a37-4cd1-953a-ee17d7b04d05 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:11.657170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31631d4f-6a37-4cd1-953a-ee17d7b04d05 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:11.660747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1c9b6-d48c-46b4-bc83-eb8960bf75a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:11.661367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c9b6-d48c-46b4-bc83-eb8960bf75a2 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:11.661651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c9b6-d48c-46b4-bc83-eb8960bf75a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:11.661928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1c9b6-d48c-46b4-bc83-eb8960bf75a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:11.671054 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1c9b6-d48c-46b4-bc83-eb8960bf75a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:11.672480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1c9b6-d48c-46b4-bc83-eb8960bf75a2 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:11.682021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 729/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:13.791957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f5c90-8c04-40ad-baed-835aeb2e568e None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:13.793035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f5c90-8c04-40ad-baed-835aeb2e568e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:13.793142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f5c90-8c04-40ad-baed-835aeb2e568e None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:13.794431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 747/1476] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:13.799715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f3bf5-8130-436a-a8d0-3e01b8f2eff9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:13.800151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f3bf5-8130-436a-a8d0-3e01b8f2eff9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:13.800285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f3bf5-8130-436a-a8d0-3e01b8f2eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:13.818572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-be7f3bf5-8130-436a-a8d0-3e01b8f2eff9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:13.819811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-be7f3bf5-8130-436a-a8d0-3e01b8f2eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:13.827527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 730/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:13.850775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f5c90-8c04-40ad-baed-835aeb2e568e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:13.863554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f5c90-8c04-40ad-baed-835aeb2e568e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:13.867927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:13.868573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:13.868858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:13.869139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:13.869984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:13.871803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:12:13.871803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:12:13.871803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:12:13.872933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b25fd-be3b-4507-a28a-d3fd8656f5fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:13.892094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 748/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jun 29 11:12:13 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:12:15.928631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7efd5-99af-4716-89cc-9905fd8a2aa7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:15.929205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7efd5-99af-4716-89cc-9905fd8a2aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:15.929205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7efd5-99af-4716-89cc-9905fd8a2aa7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:15.930805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 731/1479] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:15.936550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9d2eb-1f26-4033-85ca-bf3f4b811bed None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:15.936970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9d2eb-1f26-4033-85ca-bf3f4b811bed None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:15.937118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9d2eb-1f26-4033-85ca-bf3f4b811bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:15.954786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-18a9d2eb-1f26-4033-85ca-bf3f4b811bed None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:15.956045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-18a9d2eb-1f26-4033-85ca-bf3f4b811bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:15.964611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 749/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:16.007302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7efd5-99af-4716-89cc-9905fd8a2aa7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:16.022078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7efd5-99af-4716-89cc-9905fd8a2aa7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:16.027484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2fbe5-55d0-48ab-9b33-f9dae2b58e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:16.028120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fbe5-55d0-48ab-9b33-f9dae2b58e5f service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:16.028409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fbe5-55d0-48ab-9b33-f9dae2b58e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:16.028693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2fbe5-55d0-48ab-9b33-f9dae2b58e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:16.036740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2fbe5-55d0-48ab-9b33-f9dae2b58e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:16.038322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2fbe5-55d0-48ab-9b33-f9dae2b58e5f service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:16.048143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 732/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:18.231300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172bbaa-8be1-4380-8d9e-3b9fed4eaaf2 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:18.231878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172bbaa-8be1-4380-8d9e-3b9fed4eaaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:18.231878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172bbaa-8be1-4380-8d9e-3b9fed4eaaf2 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:18.233243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 750/1482] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:18.238494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76e3a-1dec-4a02-bee3-2b5c121bd087 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:18.238921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76e3a-1dec-4a02-bee3-2b5c121bd087 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:18.239066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a76e3a-1dec-4a02-bee3-2b5c121bd087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:18.256444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-95a76e3a-1dec-4a02-bee3-2b5c121bd087 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:18.257546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-95a76e3a-1dec-4a02-bee3-2b5c121bd087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:18.265666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 733/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:18.301823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172bbaa-8be1-4380-8d9e-3b9fed4eaaf2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:18.312932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172bbaa-8be1-4380-8d9e-3b9fed4eaaf2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:18.316435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8539508-7437-4a5b-9298-5031d0b3e929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:18.317096 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539508-7437-4a5b-9298-5031d0b3e929 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:18.317383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539508-7437-4a5b-9298-5031d0b3e929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:18.317663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8539508-7437-4a5b-9298-5031d0b3e929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:18.326995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539508-7437-4a5b-9298-5031d0b3e929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:18.328452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8539508-7437-4a5b-9298-5031d0b3e929 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:18.337727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 751/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:20.403788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4546c-4bf5-407a-ae87-a836ddbb31f7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:20.404368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4546c-4bf5-407a-ae87-a836ddbb31f7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:20.404368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4546c-4bf5-407a-ae87-a836ddbb31f7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:20.405739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 734/1485] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:20.410864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a9b70-b403-45dd-99e8-e3e3b2663604 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:20.411325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a9b70-b403-45dd-99e8-e3e3b2663604 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:20.411492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a9b70-b403-45dd-99e8-e3e3b2663604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:20.429403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-468a9b70-b403-45dd-99e8-e3e3b2663604 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:20.430860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-468a9b70-b403-45dd-99e8-e3e3b2663604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:20.439841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 752/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:12:20.482372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4546c-4bf5-407a-ae87-a836ddbb31f7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:20.493019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4546c-4bf5-407a-ae87-a836ddbb31f7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:20.497171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2f417-f30d-487e-a027-ef7c4fb3b5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:20.497798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2f417-f30d-487e-a027-ef7c4fb3b5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:20.498087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2f417-f30d-487e-a027-ef7c4fb3b5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:20.498417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2f417-f30d-487e-a027-ef7c4fb3b5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:20.507215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2f417-f30d-487e-a027-ef7c4fb3b5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:20.508650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2f417-f30d-487e-a027-ef7c4fb3b5a9 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:20.517916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 735/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:12:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:22.655963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65c744-118d-4297-8d71-e75cf8f47fc7 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:22.656377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65c744-118d-4297-8d71-e75cf8f47fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:22.656534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65c744-118d-4297-8d71-e75cf8f47fc7 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:22.657921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 753/1488] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:22.663050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5399eb-ef24-46d4-a821-d8b3bdc2e2b4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:22.663442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5399eb-ef24-46d4-a821-d8b3bdc2e2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:22.663630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5399eb-ef24-46d4-a821-d8b3bdc2e2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:22.681262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ec5399eb-ef24-46d4-a821-d8b3bdc2e2b4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:22.682443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ec5399eb-ef24-46d4-a821-d8b3bdc2e2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:22.690270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 736/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:22.731349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65c744-118d-4297-8d71-e75cf8f47fc7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:22.741890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65c744-118d-4297-8d71-e75cf8f47fc7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:22.745403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4323f-348f-4076-a0ee-a92be2197d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:22.746033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4323f-348f-4076-a0ee-a92be2197d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:22.746322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4323f-348f-4076-a0ee-a92be2197d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:22.746602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4323f-348f-4076-a0ee-a92be2197d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:22.755954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4323f-348f-4076-a0ee-a92be2197d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:22.757369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4323f-348f-4076-a0ee-a92be2197d8b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:22.767641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 754/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:12:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:24.966542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bb3a-6def-45d4-a625-8c3a73d12caf None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:24.967101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bb3a-6def-45d4-a625-8c3a73d12caf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:24.967198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5bb3a-6def-45d4-a625-8c3a73d12caf None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:24.968531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 737/1491] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jun 29 11:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:12:24.973871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68b67-647e-4996-ae0b-15b7dca0ce15 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:24.974286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68b67-647e-4996-ae0b-15b7dca0ce15 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:24.974431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68b67-647e-4996-ae0b-15b7dca0ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:24.992067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f1a68b67-647e-4996-ae0b-15b7dca0ce15 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:12:24.993255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f1a68b67-647e-4996-ae0b-15b7dca0ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:12:25.001152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 755/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jun 29 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:12:25.043816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bb3a-6def-45d4-a625-8c3a73d12caf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:12:25.054775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5bb3a-6def-45d4-a625-8c3a73d12caf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:12:25.058569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915834e8-7f35-4e5a-94aa-3229325406c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:12:25.059263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915834e8-7f35-4e5a-94aa-3229325406c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:12:25.059554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915834e8-7f35-4e5a-94aa-3229325406c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:12:25.059839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915834e8-7f35-4e5a-94aa-3229325406c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:12:25.068632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915834e8-7f35-4e5a-94aa-3229325406c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:12:25.070053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915834e8-7f35-4e5a-94aa-3229325406c5 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:12:25.079908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 738/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:12:34.986959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=33 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:12:35.075797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=33 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:13:50.365479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.365988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.366097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.383636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:13:50.384837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:50.393041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 756/1494] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:13:50.400852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.401336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.401443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.419582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:13:50.420742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:50.428425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 739/1495] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:13:50.433035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.442550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b5f1f-b307-4ff2-9832-5add6fc12154 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.446978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.447655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.447944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.448228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.449471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:13:50.449785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.450795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:50.450795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:13:50.450795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:13:50.451708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.463021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 757/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:13:50.471266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.480200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f60c0b-cf8a-4605-9f28-8a55fa2cbbba None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.484708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.485341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.485629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.485904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.486594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.488383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:50.488383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:13:50.488383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:13:50.489591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.527177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 740/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:13:50 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:13:50.529904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.539810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e8407-e642-4991-a16c-7ab1ed96a891 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.595026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.595640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.595930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.596210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.596905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.597942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:50.597942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:13:50.597942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:13:50.599182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.618714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 758/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:13:50 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:13:50.623597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.633751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f96536-eb88-4ce3-a4ef-512b48a7901d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.638787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.639475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.639763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.640039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.640756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.641759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:50.641759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:13:50.641759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:13:50.642631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.655596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 741/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:13:50.659509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.669299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f563b9-7c77-4406-a226-947646496af0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.673871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.674527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.674817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.675129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.675850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.676856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:50.676856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:13:50.676856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:13:50.677744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c0cff-0d4c-4a50-89e0-9c97d36f62de admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.691653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 759/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:13:50.695654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.706000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d737cbc-8fbd-4d53-a76e-06cbf2f1ba67 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.710435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.711357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.711642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.711918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] PATH_INFO: `/v3/projects/44aaa30a2ca344c4b059ac5e42f52c71/users/86cbc284a8ff40a8a0df765312ced2bb/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.726133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44aaa30a2ca344c4b059ac5e42f52c71, user_id=86cbc284a8ff40a8a0df765312ced2bb, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.727186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:50.727186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:13:50.727186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:13:50.729092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3d7ac-31fc-4999-831d-dab01531d835 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.741356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 742/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:13:50 2022] PUT /identity/v3/projects/44aaa30a2ca344c4b059ac5e42f52c71/users/86cbc284a8ff40a8a0df765312ced2bb/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:13:50.753887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8379-7540-4369-b830-aca90e394fc7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.754381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8379-7540-4369-b830-aca90e394fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.754562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e8379-7540-4369-b830-aca90e394fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.781097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-645e8379-7540-4369-b830-aca90e394fc7 None None] MFA Rules not processed for user `86cbc284a8ff40a8a0df765312ced2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:13:50.782298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-645e8379-7540-4369-b830-aca90e394fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:50.845388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 760/1502] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:13:50.858412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca467e3-a458-4408-93ea-69a027665931 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.858704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca467e3-a458-4408-93ea-69a027665931 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.858978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca467e3-a458-4408-93ea-69a027665931 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.860369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 743/1503] 10.222.0.48 () {54 vars in 963 bytes} [Wed Jun 29 11:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:13:50.865134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32087b-e21e-4b67-ba6f-eace420e77bf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.865436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32087b-e21e-4b67-ba6f-eace420e77bf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.865721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32087b-e21e-4b67-ba6f-eace420e77bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.883491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5a32087b-e21e-4b67-ba6f-eace420e77bf None None] MFA Rules not processed for user `adcb515e83b3484f9e93e18497fbbdfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:13:50.884679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5a32087b-e21e-4b67-ba6f-eace420e77bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:50.927468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:13:50.936619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 761/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Wed Jun 29 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:13:50.944156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca467e3-a458-4408-93ea-69a027665931 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:50.954528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca467e3-a458-4408-93ea-69a027665931 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:50.958220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:50.958859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:50.959179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:50.959463 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:50.967926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:50.969357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:50.977994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 744/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:13:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:13:51.020019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898cc7-180e-44c3-be3c-c035cce1b385 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:51.020311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898cc7-180e-44c3-be3c-c035cce1b385 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:51.020614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898cc7-180e-44c3-be3c-c035cce1b385 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:51.021914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 762/1506] 10.222.0.48 () {52 vars in 829 bytes} [Wed Jun 29 11:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:13:51.025368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:51.086293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c648-62e3-4d42-ac98-1204ebbd93f8 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:51.090790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:51.091683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:51.091965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:51.092239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] PATH_INFO: `/v3/users/86cbc284a8ff40a8a0df765312ced2bb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:51.093429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86cbc284a8ff40a8a0df765312ced2bb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:51.094437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:51.094437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:13:51.094437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:13:51.095734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:51.159462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86cbc284a8ff40a8a0df765312ced2bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.169571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86cbc284a8ff40a8a0df765312ced2bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.188365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86cbc284a8ff40a8a0df765312ced2bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.189104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86cbc284a8ff40a8a0df765312ced2bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.200187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:13:51.205386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86cbc284a8ff40a8a0df765312ced2bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.212526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 745/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:13:51 2022] DELETE /identity/v3/users/86cbc284a8ff40a8a0df765312ced2bb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:13:51.216918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:51.217209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:51.217491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:51.234752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:13:51.235978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:51.292792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 763/1508] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:13:51.301836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:51.303243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:51.360627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800ee3-56d2-41a6-b0d9-d57eeda901a2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:51.364147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f036b75-441f-435f-8a48-7d6609a523fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:51.364831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f036b75-441f-435f-8a48-7d6609a523fb service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:51.365123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f036b75-441f-435f-8a48-7d6609a523fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:51.365402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f036b75-441f-435f-8a48-7d6609a523fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:51.374310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f036b75-441f-435f-8a48-7d6609a523fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:51.375796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f036b75-441f-435f-8a48-7d6609a523fb service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:51.385079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 746/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:13:51.741077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:13:51.742505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:13:51.754531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e16c72-eec5-4b22-a1b2-16374aa2710d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:13:51.759786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:13:51.760681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:13:51.761578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:13:51.761863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] PATH_INFO: `/v3/projects/44aaa30a2ca344c4b059ac5e42f52c71` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:13:51.765028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44aaa30a2ca344c4b059ac5e42f52c71)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:13:51.765028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:13:51.765028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:13:51.765028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:13:51.765344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:13:51.826424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44aaa30a2ca344c4b059ac5e42f52c71', 'request_id': 'req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.836772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44aaa30a2ca344c4b059ac5e42f52c71', 'request_id': 'req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.850954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44aaa30a2ca344c4b059ac5e42f52c71', 'request_id': 'req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.861814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] The token cache is being invalidate because project 44aaa30a2ca344c4b059ac5e42f52c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:13:51.862103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.862836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c9f27d4a-3e9a-452f-9fb1-8b802891d9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:13:51.864412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 764/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:13:51 2022] DELETE /identity/v3/projects/44aaa30a2ca344c4b059ac5e42f52c71 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:14:01.380934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=29 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:14:01.858825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:15:37.350158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdee2d-83d8-4fdf-afd0-85e55c5465b1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:37.350748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdee2d-83d8-4fdf-afd0-85e55c5465b1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:37.350748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdee2d-83d8-4fdf-afd0-85e55c5465b1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:37.352113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:15:37.356835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335466e-029a-4d6c-95b5-261e1f2bad2b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:37.357247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335466e-029a-4d6c-95b5-261e1f2bad2b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:37.357411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335466e-029a-4d6c-95b5-261e1f2bad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:37.375356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b335466e-029a-4d6c-95b5-261e1f2bad2b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:37.376559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b335466e-029a-4d6c-95b5-261e1f2bad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:37.435868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:37.588045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdee2d-83d8-4fdf-afd0-85e55c5465b1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:37.589744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6ccdee2d-83d8-4fdf-afd0-85e55c5465b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:37.665419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdee2d-83d8-4fdf-afd0-85e55c5465b1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:37.670905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d637d1-3a41-4269-bdad-e4e7cd4fe88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:37.671593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d637d1-3a41-4269-bdad-e4e7cd4fe88c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:37.671877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d637d1-3a41-4269-bdad-e4e7cd4fe88c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:37.672156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d637d1-3a41-4269-bdad-e4e7cd4fe88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:37.680849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d637d1-3a41-4269-bdad-e4e7cd4fe88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:37.682440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d637d1-3a41-4269-bdad-e4e7cd4fe88c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:37.692090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 748/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:15:38.519162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a77a-5146-4050-a1a3-ba74b17fda9a None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:38.519726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a77a-5146-4050-a1a3-ba74b17fda9a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:38.519822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6a77a-5146-4050-a1a3-ba74b17fda9a None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:38.521203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:15:38.526279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d565783-ea6d-4682-8ed2-77136896e191 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:38.526703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d565783-ea6d-4682-8ed2-77136896e191 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:38.526844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d565783-ea6d-4682-8ed2-77136896e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:38.545144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d565783-ea6d-4682-8ed2-77136896e191 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:38.546357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d565783-ea6d-4682-8ed2-77136896e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:38.554234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:38.705042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6a77a-5146-4050-a1a3-ba74b17fda9a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:38.719239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6a77a-5146-4050-a1a3-ba74b17fda9a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:38.724532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526327-5bec-4400-9b94-6d0ab19d9540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:38.725165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526327-5bec-4400-9b94-6d0ab19d9540 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:38.725456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526327-5bec-4400-9b94-6d0ab19d9540 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:38.725740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526327-5bec-4400-9b94-6d0ab19d9540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:38.733761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526327-5bec-4400-9b94-6d0ab19d9540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:38.735389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526327-5bec-4400-9b94-6d0ab19d9540 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:38.744583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 767/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:15:39.230807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9b7a-ce43-4777-88a0-662442218ae5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:39.231122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9b7a-ce43-4777-88a0-662442218ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:39.231404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9b7a-ce43-4777-88a0-662442218ae5 None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:39.232708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 750/1517] 10.222.0.27 () {54 vars in 925 bytes} [Wed Jun 29 11:15:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:15:39.239744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d31dd3-61cb-4001-9eb5-b497f127ee57 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:39.240042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d31dd3-61cb-4001-9eb5-b497f127ee57 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:39.240327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d31dd3-61cb-4001-9eb5-b497f127ee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:39.257989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-10d31dd3-61cb-4001-9eb5-b497f127ee57 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:39.259210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-10d31dd3-61cb-4001-9eb5-b497f127ee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:39.320141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 768/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jun 29 11:15:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:48.525899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250067e-4244-4a36-81ac-08cb52e97a0a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:48.526420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250067e-4244-4a36-81ac-08cb52e97a0a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:48.526420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250067e-4244-4a36-81ac-08cb52e97a0a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:48.527759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 751/1519] 10.222.0.48 () {54 vars in 960 bytes} [Wed Jun 29 11:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:15:48.532760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2676-1d9a-4760-8a26-6aaea20de2f4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:48.533147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2676-1d9a-4760-8a26-6aaea20de2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:48.533332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2676-1d9a-4760-8a26-6aaea20de2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:48.539588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=37 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:15:48.553234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-892f2676-1d9a-4760-8a26-6aaea20de2f4 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:48.554437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-892f2676-1d9a-4760-8a26-6aaea20de2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:48.563114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 769/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Wed Jun 29 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:48.570584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250067e-4244-4a36-81ac-08cb52e97a0a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:48.584053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250067e-4244-4a36-81ac-08cb52e97a0a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:48.588853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aed1c9-76fa-4e41-98c1-ee7335c79a1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:48.589473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1c9-76fa-4e41-98c1-ee7335c79a1d service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:48.589757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1c9-76fa-4e41-98c1-ee7335c79a1d service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:48.590033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aed1c9-76fa-4e41-98c1-ee7335c79a1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:48.598536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aed1c9-76fa-4e41-98c1-ee7335c79a1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:48.600173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aed1c9-76fa-4e41-98c1-ee7335c79a1d service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:48.609510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 752/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:15:49.974537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea188-2a4a-4b6c-9e29-32eb350733c9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:49.975129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea188-2a4a-4b6c-9e29-32eb350733c9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:49.975129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ea188-2a4a-4b6c-9e29-32eb350733c9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:49.976524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:15:49.981520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ea5e-dbc3-4590-aa5f-4ecf206c86d5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:49.981907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ea5e-dbc3-4590-aa5f-4ecf206c86d5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:49.982093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0ea5e-dbc3-4590-aa5f-4ecf206c86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:50.000145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dca0ea5e-dbc3-4590-aa5f-4ecf206c86d5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:50.001356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dca0ea5e-dbc3-4590-aa5f-4ecf206c86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:50.009244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:50.162153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea188-2a4a-4b6c-9e29-32eb350733c9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:50.176991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ea188-2a4a-4b6c-9e29-32eb350733c9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:50.182344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80152d-5b66-45fe-8035-1b954027b959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:50.183283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80152d-5b66-45fe-8035-1b954027b959 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:50.183573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80152d-5b66-45fe-8035-1b954027b959 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:50.183856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80152d-5b66-45fe-8035-1b954027b959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:50.192020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80152d-5b66-45fe-8035-1b954027b959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:50.193621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80152d-5b66-45fe-8035-1b954027b959 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:50.202933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 771/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:15:51.025578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05391921-e945-4fa3-bc3b-4987d33f130f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:51.026128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05391921-e945-4fa3-bc3b-4987d33f130f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:51.026128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05391921-e945-4fa3-bc3b-4987d33f130f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:51.027533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 11:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:15:51.032207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333968-34fa-49d6-b64b-15ba616977a4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:51.032639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333968-34fa-49d6-b64b-15ba616977a4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:51.032773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1333968-34fa-49d6-b64b-15ba616977a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:51.050696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f1333968-34fa-49d6-b64b-15ba616977a4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:51.051902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f1333968-34fa-49d6-b64b-15ba616977a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:51.059785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:51.210801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05391921-e945-4fa3-bc3b-4987d33f130f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:51.225495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05391921-e945-4fa3-bc3b-4987d33f130f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:51.230792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513b87f-9a80-4f2c-9c29-42840da8c0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:51.231518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b87f-9a80-4f2c-9c29-42840da8c0c2 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:51.231806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b87f-9a80-4f2c-9c29-42840da8c0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:51.232084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b87f-9a80-4f2c-9c29-42840da8c0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:51.240706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513b87f-9a80-4f2c-9c29-42840da8c0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:51.242287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513b87f-9a80-4f2c-9c29-42840da8c0c2 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:51.251619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 755/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:15:55.140464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20addb6e-8f68-4b3e-ac2d-1d5780ccf614 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:55.141070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20addb6e-8f68-4b3e-ac2d-1d5780ccf614 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:55.141070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20addb6e-8f68-4b3e-ac2d-1d5780ccf614 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:55.142513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:15:55.148474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74076e97-985c-48c3-96f0-0ec19291c56c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:55.148900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74076e97-985c-48c3-96f0-0ec19291c56c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:55.149041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74076e97-985c-48c3-96f0-0ec19291c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:55.166857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-74076e97-985c-48c3-96f0-0ec19291c56c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:55.168054 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-74076e97-985c-48c3-96f0-0ec19291c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:55.175751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:55.213984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20addb6e-8f68-4b3e-ac2d-1d5780ccf614 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:55.215653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20addb6e-8f68-4b3e-ac2d-1d5780ccf614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:55.272225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20addb6e-8f68-4b3e-ac2d-1d5780ccf614 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:55.275599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d638beb-7f68-4675-bb19-fc5b9428a456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:55.276269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d638beb-7f68-4675-bb19-fc5b9428a456 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:55.276555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d638beb-7f68-4675-bb19-fc5b9428a456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:55.276834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d638beb-7f68-4675-bb19-fc5b9428a456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:55.285623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d638beb-7f68-4675-bb19-fc5b9428a456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:55.287086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d638beb-7f68-4675-bb19-fc5b9428a456 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:55.291960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:15:55.296848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 774/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:15:57.319121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52865b6b-e790-473e-ad77-30c21d767556 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:57.319660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52865b6b-e790-473e-ad77-30c21d767556 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:57.319771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52865b6b-e790-473e-ad77-30c21d767556 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:57.321145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:15:57.326330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10dc32-ec94-43ec-97e0-1fd2e1740e9e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:57.326726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10dc32-ec94-43ec-97e0-1fd2e1740e9e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:57.326902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10dc32-ec94-43ec-97e0-1fd2e1740e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:57.344642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0f10dc32-ec94-43ec-97e0-1fd2e1740e9e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:15:57.345826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0f10dc32-ec94-43ec-97e0-1fd2e1740e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:15:57.354105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:15:57.389250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52865b6b-e790-473e-ad77-30c21d767556 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:15:57.399990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52865b6b-e790-473e-ad77-30c21d767556 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:15:57.403453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c5ef0-0093-4861-9d2f-f12954d1e8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:15:57.404082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5ef0-0093-4861-9d2f-f12954d1e8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:15:57.404370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5ef0-0093-4861-9d2f-f12954d1e8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:15:57.404651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5ef0-0093-4861-9d2f-f12954d1e8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:15:57.413993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c5ef0-0093-4861-9d2f-f12954d1e8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:15:57.415467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c5ef0-0093-4861-9d2f-f12954d1e8d2 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:15:57.425629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 758/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:16:00.867803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477d1d-698f-4253-ac27-178ac30b3aeb None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:16:00.868387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477d1d-698f-4253-ac27-178ac30b3aeb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:16:00.868387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477d1d-698f-4253-ac27-178ac30b3aeb None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:16:00.869746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:16:00.874946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8d03-5db3-4915-9cf3-b42260a46fa7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:16:00.875386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8d03-5db3-4915-9cf3-b42260a46fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:16:00.875546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8d03-5db3-4915-9cf3-b42260a46fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:16:00.894729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8bee8d03-5db3-4915-9cf3-b42260a46fa7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:16:00.896009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8bee8d03-5db3-4915-9cf3-b42260a46fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:16:00.903810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:16:01.203705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477d1d-698f-4253-ac27-178ac30b3aeb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:16:01.205365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-81477d1d-698f-4253-ac27-178ac30b3aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:16:01.262383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477d1d-698f-4253-ac27-178ac30b3aeb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:16:01.265932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2eba2-df50-42d0-9390-fccdb92f3f86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:16:01.266573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2eba2-df50-42d0-9390-fccdb92f3f86 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:16:01.266863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2eba2-df50-42d0-9390-fccdb92f3f86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:16:01.267173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2eba2-df50-42d0-9390-fccdb92f3f86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:16:01.276082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2eba2-df50-42d0-9390-fccdb92f3f86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:16:01.277497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2eba2-df50-42d0-9390-fccdb92f3f86 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:16:01.286778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 777/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:16:03.309058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ce69-094c-4688-b7d6-547f1f57cd22 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:16:03.309567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ce69-094c-4688-b7d6-547f1f57cd22 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:16:03.309567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ce69-094c-4688-b7d6-547f1f57cd22 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:16:03.310921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 11:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:16:03.316604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac5b6-419e-49fe-9898-dfafc9099488 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:16:03.317009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac5b6-419e-49fe-9898-dfafc9099488 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:16:03.317145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ac5b6-419e-49fe-9898-dfafc9099488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:16:03.335314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-958ac5b6-419e-49fe-9898-dfafc9099488 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:16:03.336487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-958ac5b6-419e-49fe-9898-dfafc9099488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:16:03.344099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 11:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:16:03.643420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ce69-094c-4688-b7d6-547f1f57cd22 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:16:03.645163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ed86ce69-094c-4688-b7d6-547f1f57cd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:16:03.658002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86ce69-094c-4688-b7d6-547f1f57cd22 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:16:03.661477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8397-e464-455f-be4b-99c5d1ec1329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:16:03.662104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8397-e464-455f-be4b-99c5d1ec1329 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:16:03.662386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8397-e464-455f-be4b-99c5d1ec1329 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:16:03.662660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8397-e464-455f-be4b-99c5d1ec1329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:16:03.671723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a8397-e464-455f-be4b-99c5d1ec1329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:16:03.673139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a8397-e464-455f-be4b-99c5d1ec1329 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:16:03.683377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 761/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:16:13.329656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=32 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:16:13.678887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=33 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:35.952971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:35.957914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:35.957914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:35.979534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:35.980752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:35.999513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 779/1540] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:17:36.009022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.009528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.009621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.036813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.038029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.048994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 762/1541] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.053718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.064302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcf0d9-7841-49ff-84f9-a899adcdffbf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.075187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.075882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.076173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.076458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.077199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:36.077511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.082751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.099456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 780/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:36.104568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.114797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db084edb-223d-49a8-a2e3-488cc69c7a8d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.122186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.122864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.123400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.123694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.124424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.126420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.179527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 763/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:36.187285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.199054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d400d-875d-4fe4-a227-46774822c10d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.276171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.276802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.277097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.277383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.278108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.280241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.319004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 781/1544] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:36.323634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.336956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328a9ea-10e5-434a-8712-5ac89bdd9519 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.347100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.347809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.348104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.348385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.349187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.350866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.368576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 764/1545] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:36.373089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.390133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ecb50-91df-4372-b267-25be58ed4829 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.398555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6ab2e-976e-4f5d-9252-a4fb725f3780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.399279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6ab2e-976e-4f5d-9252-a4fb725f3780 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.399570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6ab2e-976e-4f5d-9252-a4fb725f3780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.399854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6ab2e-976e-4f5d-9252-a4fb725f3780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.400585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6ab2e-976e-4f5d-9252-a4fb725f3780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.402208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa6ab2e-976e-4f5d-9252-a4fb725f3780 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.419722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 782/1546] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:36.424145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.437169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f42ff-c45b-4eb3-bffa-98a8fb7cde09 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.446147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.447066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.447421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.447709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] PATH_INFO: `/v3/projects/1608785b7ce14af7a1c8efe2fcfb7a6c/users/b030be7717f44bf1937ae3b548f7f81b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.470369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1608785b7ce14af7a1c8efe2fcfb7a6c, user_id=b030be7717f44bf1937ae3b548f7f81b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.473299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.505146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 765/1547] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:36 2022] PUT /identity/v3/projects/1608785b7ce14af7a1c8efe2fcfb7a6c/users/b030be7717f44bf1937ae3b548f7f81b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:36.511270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857d18-7d4f-42fd-b84b-fa335de65134 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.511770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857d18-7d4f-42fd-b84b-fa335de65134 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.512064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857d18-7d4f-42fd-b84b-fa335de65134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.540641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-52857d18-7d4f-42fd-b84b-fa335de65134 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.541756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-52857d18-7d4f-42fd-b84b-fa335de65134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.623601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 783/1548] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.643061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.716307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd03c2-8546-4f19-b847-d05a4ff6c3f2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.721360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dcec5-6c00-40db-943c-e22a3fd55908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:36.722071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dcec5-6c00-40db-943c-e22a3fd55908 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.722366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dcec5-6c00-40db-943c-e22a3fd55908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.722650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dcec5-6c00-40db-943c-e22a3fd55908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.737116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dcec5-6c00-40db-943c-e22a3fd55908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:36.739170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dcec5-6c00-40db-943c-e22a3fd55908 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:36.753394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 766/1549] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:36.767620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299531-3bde-4cb5-900f-4055a4e80ce5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.767952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299531-3bde-4cb5-900f-4055a4e80ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.768190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49299531-3bde-4cb5-900f-4055a4e80ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.804102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-49299531-3bde-4cb5-900f-4055a4e80ce5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.805348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49299531-3bde-4cb5-900f-4055a4e80ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.822220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a862-ff0b-4a89-bcf2-6fb3bc865891 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.822405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a862-ff0b-4a89-bcf2-6fb3bc865891 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.822664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847a862-ff0b-4a89-bcf2-6fb3bc865891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.827125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 784/1550] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.828542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843306fc-4907-4954-804f-e7eb6759e20a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.828837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843306fc-4907-4954-804f-e7eb6759e20a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.829118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843306fc-4907-4954-804f-e7eb6759e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.874559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-843306fc-4907-4954-804f-e7eb6759e20a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.875926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e847a862-ff0b-4a89-bcf2-6fb3bc865891 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.876063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-843306fc-4907-4954-804f-e7eb6759e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.878790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e847a862-ff0b-4a89-bcf2-6fb3bc865891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.893223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 785/1551] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.895929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.896080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 767/1552] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.896930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.898047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7543b3-5985-4afb-90ac-df05d36383ff None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.898346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.899183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7543b3-5985-4afb-90ac-df05d36383ff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.899468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7543b3-5985-4afb-90ac-df05d36383ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.937014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0f7543b3-5985-4afb-90ac-df05d36383ff None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.938504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0f7543b3-5985-4afb-90ac-df05d36383ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.938692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.940010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.947544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 768/1553] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.957018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd7cd5-26df-42d6-8fca-17f2466ba53e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.957018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd7cd5-26df-42d6-8fca-17f2466ba53e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.957018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd7cd5-26df-42d6-8fca-17f2466ba53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:36.958545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 786/1554] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.961184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:36.980690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b48c6-75e7-49be-ada3-fad35b4d9cc0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:36.985789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0fcd7cd5-26df-42d6-8fca-17f2466ba53e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:36.987246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0fcd7cd5-26df-42d6-8fca-17f2466ba53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:36.998176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 769/1555] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:36.999897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f4c2-6aa5-49ec-88b1-7cf3a120fd05 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:36.999897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f4c2-6aa5-49ec-88b1-7cf3a120fd05 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:36.999897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836f4c2-6aa5-49ec-88b1-7cf3a120fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.003627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.004937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.006138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.006779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.007792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.008277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.011481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08acccb-60ec-4971-9401-bdc44bdc01d2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.021804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9836f4c2-6aa5-49ec-88b1-7cf3a120fd05 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.025732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9836f4c2-6aa5-49ec-88b1-7cf3a120fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.031566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 787/1556] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.033231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0b6e8-4127-4d8e-9762-1cb30fb20e56 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.034069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0b6e8-4127-4d8e-9762-1cb30fb20e56 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.035449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0b6e8-4127-4d8e-9762-1cb30fb20e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.036466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 770/1557] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.037886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367a7b2-f6cb-4e81-b1e4-53595836867a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.038288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367a7b2-f6cb-4e81-b1e4-53595836867a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.039077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367a7b2-f6cb-4e81-b1e4-53595836867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.065000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6367a7b2-f6cb-4e81-b1e4-53595836867a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.066401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6367a7b2-f6cb-4e81-b1e4-53595836867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.080520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 771/1558] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.081976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.082277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.082650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.086752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4ea0b6e8-4127-4d8e-9762-1cb30fb20e56 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.088024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4ea0b6e8-4127-4d8e-9762-1cb30fb20e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.096660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 788/1559] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.098717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.099146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.099513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.108004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.109357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.119083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 772/1560] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.123023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.124525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.126308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.132914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff8e6-18a3-401e-9ce9-94214d47807d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.137244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 789/1561] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.138357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.140740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.141534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.141913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.142444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.143328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.143643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.145238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:37.145238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:17:37.145238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:17:37.146154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.156238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1a800-bfcc-4085-9a9e-61d14304086f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.159469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 773/1562] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.160889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.168483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.169434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.169985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.170587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.171758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.174405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:37.174405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:17:37.174405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:17:37.175994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6e580-976a-40e7-a976-d5b3259f9100 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.177004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ee7ad-55de-4d7c-9ac0-a958ad0bddfd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.181506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.182403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.183265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.184125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.185710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.186029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.187916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd578b9-eed4-4f3d-aeee-9d6108675ba9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.200181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:37.215577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 774/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.215577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.215577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.215577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.236770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 790/1564] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.243627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.244165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.244678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.246179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.247601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.264876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.266517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.284424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:37.323132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 775/1565] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.324430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.339346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08492f-9b78-4aea-9eb9-50674d4e2aa5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.345420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.345723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.345723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.346016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.347922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.348118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.348371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 791/1566] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.350320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.352361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.364818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 776/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.367847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.367980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f576-c493-4db1-bd12-9fd2d0e427f3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.375404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.376217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.377346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.377346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.377751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.378129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.380109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.382214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29e3b-22c4-4854-bb02-16573eccc456 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.387223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.387990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.388281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.388563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.389258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.391615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.393272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 792/1568] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.393877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.411323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e1dd4-1e8b-4dfc-aaa2-dc6b598fac82 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.416425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33800eb0-5c06-43f7-8cd7-e0bf23169c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.417339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800eb0-5c06-43f7-8cd7-e0bf23169c7f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.417701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800eb0-5c06-43f7-8cd7-e0bf23169c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.418030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800eb0-5c06-43f7-8cd7-e0bf23169c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.419078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800eb0-5c06-43f7-8cd7-e0bf23169c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.421646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800eb0-5c06-43f7-8cd7-e0bf23169c7f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.433623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 777/1569] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.433623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.457466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 793/1570] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.457466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127408e-bf12-473d-962d-058757755a38 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.457466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127408e-bf12-473d-962d-058757755a38 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.457466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127408e-bf12-473d-962d-058757755a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.477556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f127408e-bf12-473d-962d-058757755a38 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:37.478838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f127408e-bf12-473d-962d-058757755a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:37.520419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd6e27-f542-49f4-8750-a5e90d969243 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.577275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 794/1571] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:37.578682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127408e-bf12-473d-962d-058757755a38 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.591755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127408e-bf12-473d-962d-058757755a38 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.595287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.595940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.596288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.596581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.597779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.599821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:37.599821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:17:37.599821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:17:37.600676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.601358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.602248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.603484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.603960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.605456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.605977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.608616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.622755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 795/1572] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.624005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.636960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 778/1573] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.636960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.637247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd1d4-7594-4abd-949f-2af06fe3b5ca admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.642187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.642924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.643301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.643727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.645031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.646961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.648090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe74c2-f968-4b0a-ab5b-42de0ac09e0a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.652811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.653552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.653909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.654266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.655080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.657067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.686179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 796/1574] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.687253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.704665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 779/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.704665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.723064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:37.728468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:37.790981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3978c-c3b6-4967-ad4b-6608f7437291 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.793538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb647f86-a4cf-4534-84f7-c9c75fec490f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.796548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.797423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.797818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.798213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.799131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.799427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.800229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.800608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.801023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.801280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.801890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.804101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.834800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 780/1576] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.834800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.835946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 797/1577] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.836827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.849072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21bf4-6c42-402e-ab24-6b9c61ee0eba admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.852339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3158cd-28d4-4698-8252-72648a9d7bbb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.856133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.857299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.857585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.857891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.859288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:37.859457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.861316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.861546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.862429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.863730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.864224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.865245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.867731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.877459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 781/1578] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:37.878396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.897077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290f15a-95b5-4bce-a8c4-aea58c7ca39c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:37.902235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:37.902914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:37.903349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:37.903635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:37.904474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:37.906439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:37.907174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 798/1579] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:37.909295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.917999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 782/1580] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:37.918844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:37.930945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb44be-ce6e-4ca0-904f-bbc2f7df27e8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.005856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc786b8-5a82-4859-90b8-94983b8f63a1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.008485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.009778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.010224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.010671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.011489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.012163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.013061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.013514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.013892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.014122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.014975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.017381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.042126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 783/1581] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:38.043204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.048858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 799/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:37 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:38.049985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.061862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2dee9-b3d4-4795-90f5-eab2ba807bc0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.065462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794ad3-9947-4e97-b15a-7bc42fb9f796 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.071174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.072536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.072953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.073403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.073751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.074090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.074380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.074661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.075432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.075562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.077511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.077652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.093451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 800/1583] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.093451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.094224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 784/1584] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.095371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.105746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425276c8-58d2-494b-b313-50bb548453c9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.106818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e962ed-aa86-41c8-963e-90a1290161d0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.116174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.116174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.116174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.116174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.116527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.116612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.119519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.119913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.120301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.121133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.123260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.123531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.155831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 785/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:38 2022] POST /identity/v3/users => generated 289 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:38.155831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.171178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 801/1586] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:38 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:38.172630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.178979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52c714-0375-4505-88c6-c9fc5477a558 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.230485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:38.252912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:38.259124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.260602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.260795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.261243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.262032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.264371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.276798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e05483-3b47-4e37-a52e-ecc2161b0c19 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.278892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 786/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.280328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.285742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.286514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.286900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.288044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.288044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.290114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.295336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb816f-3835-4219-a185-80498794d0a3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.302407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.302632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 802/1588] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.304051 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.305225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.305781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.306273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.307229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.309366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.317760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f28e87-69bb-4dea-baa5-f83e017e21be admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.326796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.327506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.327795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.328077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.328806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.329761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 787/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.330480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.333695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.349492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128003-087f-4e9e-8e9f-24c953b5d370 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.359171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 803/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.361171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.365843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.366987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.367345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.367851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.368991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.370528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.375142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca719b-fb04-4c6a-bf66-8addcf8e0c68 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.384371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.385633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 788/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.385746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.385746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.385746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.385746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.388710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.392261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.404283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 804/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.404283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.404571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa04655-49cf-47f9-9582-1efda539fcf6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.408563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.409321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.410198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.410575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.411525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.413702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.414912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f5ed0-4573-43b4-83d7-01a125518dc7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.419981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.421341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.421341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.421554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] PATH_INFO: `/v3/projects/9fe8002ecc90407fbb4c4c9cd0c95cca/users/3d5b8efef52b4c32b27d107b452697e5/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.439655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 789/1593] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:38 2022] POST /identity/v3/users => generated 297 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:38.440480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.440833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe8002ecc90407fbb4c4c9cd0c95cca, user_id=3d5b8efef52b4c32b27d107b452697e5, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.441875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:38.441875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:17:38.441875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:17:38.443934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.456276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ef65f-54bf-4aaf-a870-d07a425b8ca0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.459405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 805/1594] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:38 2022] PUT /identity/v3/projects/9fe8002ecc90407fbb4c4c9cd0c95cca/users/3d5b8efef52b4c32b27d107b452697e5/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:38.460689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.533757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.535169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.535468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.535754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.538019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.540109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.547336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e009a8-ade0-46a0-b581-d1063cc56486 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.557126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 790/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.557340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.557340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.557528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.557640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.557640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.557640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.558260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.566974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1be36-c249-4c9f-b134-444c5bd254f7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.570859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 806/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.572083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.576720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.577918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.578464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.578937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] PATH_INFO: `/v3/projects/7f366ac50f3e4d8f859a4633fdf798a2/users/acee9273e0714017bb29bbc578847b53/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.590496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c961c5-dfbd-401c-9070-2844118d2739 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.598524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.599612 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.599903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.600186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] PATH_INFO: `/v3/projects/b98b8f9187ff4bcc9cc0f8b69fc0615a/users/2ab3cbf49f514ba0bc7cf2e387f4933f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.601692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f366ac50f3e4d8f859a4633fdf798a2, user_id=acee9273e0714017bb29bbc578847b53, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.606350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.627818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 791/1597] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:38 2022] PUT /identity/v3/projects/7f366ac50f3e4d8f859a4633fdf798a2/users/acee9273e0714017bb29bbc578847b53/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:38.628021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b98b8f9187ff4bcc9cc0f8b69fc0615a, user_id=2ab3cbf49f514ba0bc7cf2e387f4933f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.628473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.630411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.710176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 807/1598] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:38 2022] PUT /identity/v3/projects/b98b8f9187ff4bcc9cc0f8b69fc0615a/users/2ab3cbf49f514ba0bc7cf2e387f4933f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:38.710176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.744400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e2ed3-f096-46e3-b1d9-0fdf8a946c33 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.759666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:38.778483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2766e6e-812a-4440-8790-8f7d90c6e7f5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.786346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2c08b-bdda-4b00-9e23-38a87f13b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.787057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c08b-bdda-4b00-9e23-38a87f13b103 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.787362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c08b-bdda-4b00-9e23-38a87f13b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.787644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2c08b-bdda-4b00-9e23-38a87f13b103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.788377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2c08b-bdda-4b00-9e23-38a87f13b103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.790172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2c08b-bdda-4b00-9e23-38a87f13b103 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.804393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 808/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.805685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd4d3-93a0-482c-80a2-010f9b20f7d8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.806147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd4d3-93a0-482c-80a2-010f9b20f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.806437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadd4d3-93a0-482c-80a2-010f9b20f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.816024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:38.830424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.832381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.832751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.833100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.834157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.836099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.846367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5dadd4d3-93a0-482c-80a2-010f9b20f7d8 None None] MFA Rules not processed for user `3d5b8efef52b4c32b27d107b452697e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:38.848339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5dadd4d3-93a0-482c-80a2-010f9b20f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:38.849457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 792/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:38.851016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.861759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cfdc6-0af8-49a9-895e-9437b672aa52 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:38.867332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:38.868298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.868649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.869003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] PATH_INFO: `/v3/projects/db45afc3940b4337967303a4338e097a/users/fbe1be41bdcf4c62a0988185b699fa97/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.884074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db45afc3940b4337967303a4338e097a, user_id=fbe1be41bdcf4c62a0988185b699fa97, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:38.887130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:38.901907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 793/1601] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:38 2022] PUT /identity/v3/projects/db45afc3940b4337967303a4338e097a/users/fbe1be41bdcf4c62a0988185b699fa97/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:38.903077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:38.948743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 809/1602] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:38.949982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb29056-f651-44cd-9cea-eb89469c2b04 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:38.950278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb29056-f651-44cd-9cea-eb89469c2b04 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:38.950556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb29056-f651-44cd-9cea-eb89469c2b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:38.969292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0fb29056-f651-44cd-9cea-eb89469c2b04 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:38.970492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0fb29056-f651-44cd-9cea-eb89469c2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:38.999323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a268-71a6-49a1-84b6-1d9db8144045 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.011129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.011645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.011958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.012237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] PATH_INFO: `/v3/projects/f147641fd5844427b89cf4f1bafdda91/users/f86bda6a4b2c43259a663a6ae2f9db8f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.029413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f147641fd5844427b89cf4f1bafdda91, user_id=f86bda6a4b2c43259a663a6ae2f9db8f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.033283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.046578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 810/1603] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:39.046578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.046578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.046578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.055242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 794/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:38 2022] PUT /identity/v3/projects/f147641fd5844427b89cf4f1bafdda91/users/f86bda6a4b2c43259a663a6ae2f9db8f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:39.056613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.073885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:39.076994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:39.135621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb6df6-7c39-4ee2-89d2-d225b41972fb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.141234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfafa0-4bf0-4515-9c53-afcc8ba123e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.142004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfafa0-4bf0-4515-9c53-afcc8ba123e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.142393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfafa0-4bf0-4515-9c53-afcc8ba123e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.142792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfafa0-4bf0-4515-9c53-afcc8ba123e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.144763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfafa0-4bf0-4515-9c53-afcc8ba123e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.146928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 811/1605] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:39.148053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.149929 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfafa0-4bf0-4515-9c53-afcc8ba123e2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.158409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3080cf1-82e8-4388-b517-9d529c11ab63 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.164642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 795/1606] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:39.164642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.164642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.164642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.168102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.169025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.169305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.169581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] PATH_INFO: `/v3/projects/f26e25d654ca4479850d336d1884e754/users/fb03aabb4dfe4e17bf12831cc5824612/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.179078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:39.200562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26e25d654ca4479850d336d1884e754, user_id=fb03aabb4dfe4e17bf12831cc5824612, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.203636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.208745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] MFA Rules not processed for user `fbe1be41bdcf4c62a0988185b699fa97`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:39.209964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:39.229922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 812/1607] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:39 2022] PUT /identity/v3/projects/f26e25d654ca4479850d336d1884e754/users/fb03aabb4dfe4e17bf12831cc5824612/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:39.231742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.248114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:39.313081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 796/1608] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:39.313955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.338897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697f7fe-c52c-42e3-9d05-e60cc0943642 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.348993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f14247-2adb-403d-8c9c-393b1468ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.349980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f14247-2adb-403d-8c9c-393b1468ad29 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.349980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f14247-2adb-403d-8c9c-393b1468ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.350199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f14247-2adb-403d-8c9c-393b1468ad29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.351782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f14247-2adb-403d-8c9c-393b1468ad29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.353036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f14247-2adb-403d-8c9c-393b1468ad29 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.399198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 813/1609] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:39.400753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.401056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.401438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.402290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72df7f8-2ee6-473c-b2c6-fe39be23f18a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.434210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] MFA Rules not processed for user `f86bda6a4b2c43259a663a6ae2f9db8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:39.435784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:39.465927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.466593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.467205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.467491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.530930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 814/1610] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:39.531769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.549105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.551442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.563660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 797/1611] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:39.565603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.571858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:39.581894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eb9ff-f852-48ed-85c6-5996fc0667a6 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.586911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa83cca-6d95-485a-a039-d4156092b1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.587940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83cca-6d95-485a-a039-d4156092b1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.588504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83cca-6d95-485a-a039-d4156092b1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.588998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83cca-6d95-485a-a039-d4156092b1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.600775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83cca-6d95-485a-a039-d4156092b1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.603497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83cca-6d95-485a-a039-d4156092b1d4 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.619955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 798/1612] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:39.620954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb57fb-2060-4afa-a7ce-52eb9ba93fe0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.621491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.621926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.622220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.632322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.634611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.634902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.635207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] PATH_INFO: `/v3/projects/93a6d11eb9fa425182a7106c78e90bbb/users/eb03b2aff9674231b7275a12171a3197/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.646232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:39.647600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:39.657113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a6d11eb9fa425182a7106c78e90bbb, user_id=eb03b2aff9674231b7275a12171a3197, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.657552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 799/1613] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:39.658505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.660023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.671032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbd422-85e3-4cc5-b28d-5ea78a45f99c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.678585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 815/1614] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:39 2022] PUT /identity/v3/projects/93a6d11eb9fa425182a7106c78e90bbb/users/eb03b2aff9674231b7275a12171a3197/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:39.679386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.692889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:39.764674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf28b-a27c-4ffe-9c74-454f394a6c70 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.771079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.772287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.772837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.773088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abafc11-6faf-4528-9c56-e4a13d44cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.773231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.773778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafc11-6faf-4528-9c56-e4a13d44cf6e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.774060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafc11-6faf-4528-9c56-e4a13d44cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.774345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafc11-6faf-4528-9c56-e4a13d44cf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.774451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.775068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abafc11-6faf-4528-9c56-e4a13d44cf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.776415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.777283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abafc11-6faf-4528-9c56-e4a13d44cf6e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.804743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 816/1615] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:39.816106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.828955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7909c7-392e-43d3-b735-082dc8dd258c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.835321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.836307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.836481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.836745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.837535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:39.839656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:39.840855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 800/1616] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:39.842731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.842731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.842966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:39.876311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 817/1617] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:39.877481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:39.881752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:39.886508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:39.887987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:39.951549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7f58-770f-4c3f-8342-89fe101b6a78 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:39.960586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:39.960955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:39.961150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:39.961433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.053063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 801/1618] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:40.054047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.077465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.081276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c87d50-b5a6-4cd6-ac54-82775c09f1b9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.082569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.096824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.097641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.097995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.098340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.099179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.102625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.105869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 818/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:40.107719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.132912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 802/1620] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:40.134090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede82d6b-829d-4419-ad8a-c598f5b0dbf9 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.134956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.146513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.149067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.149517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.150817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.151895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.155448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.159940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee55d-36b3-4097-805d-63e2978be3a7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.176996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.179200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.180420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.180904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.182924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.189626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.212735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 819/1621] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:40 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:40.212735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.238591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100d1e-e998-403a-9a27-19baab0fa39c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.239815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 803/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:40 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:40.240952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.251823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.252918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.253931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.254543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] PATH_INFO: `/v3/projects/ebc4543d691b404799e90b9e6dffab65/users/d76a058b43a84e8a8a24da4935e11f38/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.263531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:40.264920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a4d34-7d8c-4886-ab23-62c40619a70c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.278067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.280560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.280967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.282369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.296934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc4543d691b404799e90b9e6dffab65, user_id=d76a058b43a84e8a8a24da4935e11f38, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.304753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.308078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.310823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.332928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 820/1623] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:40 2022] PUT /identity/v3/projects/ebc4543d691b404799e90b9e6dffab65/users/d76a058b43a84e8a8a24da4935e11f38/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:40.335571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.339531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 804/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:40.340394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.377705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140cf0b-d3dd-4600-ada8-11a111aa38d2 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.437634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587bdb2-10ed-4144-ae51-6688a3854188 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.443698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:40.445617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.446559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.447247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.447832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.448826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.451240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.469531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 821/1625] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:40.470761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.484514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f089de8-abf0-4c3c-9e03-1f8e6dc68c12 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.491688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.492898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.493796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.494298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.495312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.498019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.514666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 822/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:40.515970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.530770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089172ef-c065-40a7-9b24-52b6ff5c2aa3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.531025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.532008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.532896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.534035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.537082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.537221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.538710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.538862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.539222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.539735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] PATH_INFO: `/v3/projects/9e99ffc3eb5a41b6bbfb96e1b2fca0a4/users/bc7562ee6b344bdebac0007d24dc2785/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.566146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e99ffc3eb5a41b6bbfb96e1b2fca0a4, user_id=bc7562ee6b344bdebac0007d24dc2785, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.573468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 805/1627] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:40.574238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.574634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.595081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 823/1628] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:40 2022] PUT /identity/v3/projects/9e99ffc3eb5a41b6bbfb96e1b2fca0a4/users/bc7562ee6b344bdebac0007d24dc2785/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:40.596180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.605313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496dd8-0e5a-4e3b-9c8a-2ee372c3a8fa admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.693212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eac25-45fe-4ddb-84c4-d8923a1e87d5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.699433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.700738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.701305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.701705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] PATH_INFO: `/v3/projects/b3df7f551eff4adbb5aedbd7a13d3b1c/users/3eb3b1edfedf4a6a89539b2fd4fa0e1d/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.720232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3df7f551eff4adbb5aedbd7a13d3b1c, user_id=3eb3b1edfedf4a6a89539b2fd4fa0e1d, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.724133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.743323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 824/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:40 2022] PUT /identity/v3/projects/b3df7f551eff4adbb5aedbd7a13d3b1c/users/3eb3b1edfedf4a6a89539b2fd4fa0e1d/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:40.744422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.759822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.760748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.761041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.761321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] PATH_INFO: `/v3/projects/ebc4543d691b404799e90b9e6dffab65/users/d76a058b43a84e8a8a24da4935e11f38/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.768589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc4543d691b404799e90b9e6dffab65, user_id=d76a058b43a84e8a8a24da4935e11f38, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.771370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.791028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:40.811668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 806/1630] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:40 2022] PUT /identity/v3/projects/ebc4543d691b404799e90b9e6dffab65/users/d76a058b43a84e8a8a24da4935e11f38/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:40.812959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:40.838357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f6d3-9f07-4aa4-aa2b-91ba07c35831 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.930391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d5c7f-6b37-4a8d-a922-ff3acd9956ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.931162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5c7f-6b37-4a8d-a922-ff3acd9956ab admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.931563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5c7f-6b37-4a8d-a922-ff3acd9956ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.931848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d5c7f-6b37-4a8d-a922-ff3acd9956ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.933347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5c7f-6b37-4a8d-a922-ff3acd9956ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.936576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d5c7f-6b37-4a8d-a922-ff3acd9956ab admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:40.953248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 825/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:40.953248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ae214-64fb-4aea-9bee-a2d22b0b71dc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.953248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ae214-64fb-4aea-9bee-a2d22b0b71dc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.953248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ae214-64fb-4aea-9bee-a2d22b0b71dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.963374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354f72b-fdd3-4115-a6dd-285284531f05 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:40.977490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:40.978184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:40.978483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:40.978768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:40.979543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:40.981183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:41.001341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ac1ae214-64fb-4aea-9bee-a2d22b0b71dc None None] MFA Rules not processed for user `d76a058b43a84e8a8a24da4935e11f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:41.005028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ac1ae214-64fb-4aea-9bee-a2d22b0b71dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:41.014758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 807/1632] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:41.018224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:41.046723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92e135-f6e9-4d87-8768-e970019d77d6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:41.061357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:41.062295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.063134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.064684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] PATH_INFO: `/v3/projects/9e99ffc3eb5a41b6bbfb96e1b2fca0a4/users/bc7562ee6b344bdebac0007d24dc2785/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.070378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e99ffc3eb5a41b6bbfb96e1b2fca0a4, user_id=bc7562ee6b344bdebac0007d24dc2785, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:41.078696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:41.107971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 808/1633] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:41 2022] PUT /identity/v3/projects/9e99ffc3eb5a41b6bbfb96e1b2fca0a4/users/bc7562ee6b344bdebac0007d24dc2785/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:41.110288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:41.133156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 826/1634] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:41.133156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb436b6-55da-43fd-b30a-a23740e9c65d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.133805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb436b6-55da-43fd-b30a-a23740e9c65d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.133805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb436b6-55da-43fd-b30a-a23740e9c65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.202024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2eb436b6-55da-43fd-b30a-a23740e9c65d None None] MFA Rules not processed for user `bc7562ee6b344bdebac0007d24dc2785`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:41.205719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2eb436b6-55da-43fd-b30a-a23740e9c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:41.217986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:41.268566 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a784ad-3ed9-4ebe-9cf7-164abf486459 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:41.282326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:41.283269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.283556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.283835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] PATH_INFO: `/v3/projects/b3df7f551eff4adbb5aedbd7a13d3b1c/users/3eb3b1edfedf4a6a89539b2fd4fa0e1d/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.288197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3df7f551eff4adbb5aedbd7a13d3b1c, user_id=3eb3b1edfedf4a6a89539b2fd4fa0e1d, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:41.290897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:41.303633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:41.314577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 809/1635] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:41 2022] PUT /identity/v3/projects/b3df7f551eff4adbb5aedbd7a13d3b1c/users/3eb3b1edfedf4a6a89539b2fd4fa0e1d/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:41.315664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:41.352812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 827/1636] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:41.354133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.354437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.354724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.410317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaeb8d-b354-43ff-91f1-3829f2502f92 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:41.417899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:41.418258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.418553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.419024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.431492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] MFA Rules not processed for user `3eb3b1edfedf4a6a89539b2fd4fa0e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:41.432877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:41.550279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:41.553660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:41.584701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 810/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:41.586020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:41.617579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584d992-fab1-4d60-852f-b817f76bbc6f service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:41.629328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 828/1638] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:41.639780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:41.642290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.642897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.643996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.665879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:41.681516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8d11-8d76-4ab3-aef4-65655d86c125 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:41.700234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:41.701596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:41.706260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:41.707996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:41.731933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:41.733734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:41.781360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 829/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:41.833416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:41.834959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:41.852043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 811/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:42.049316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:42.067910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c8181-c6db-4018-b233-d18a1209f529 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:42.081186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:42.083930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:42.084948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:42.085497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:42.257503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:42.263526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:42.291522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 830/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:42.706805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:42.716482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148d414-c6f6-4522-bf25-abf14049232a service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:42.734797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12ee33-1737-4f82-a874-d66a9f0ed02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:42.735509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ee33-1737-4f82-a874-d66a9f0ed02b service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:42.735797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ee33-1737-4f82-a874-d66a9f0ed02b service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:42.736085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12ee33-1737-4f82-a874-d66a9f0ed02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:42.813049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:42.933095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12ee33-1737-4f82-a874-d66a9f0ed02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:42.934840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12ee33-1737-4f82-a874-d66a9f0ed02b service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:42.959981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 812/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:44.377603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:44.388990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a2814-daac-4b6e-b786-4cf92b070097 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:44.407951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bb66b-f787-49d2-986f-d56f05d7be35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:44.413389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb66b-f787-49d2-986f-d56f05d7be35 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:44.414041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb66b-f787-49d2-986f-d56f05d7be35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:44.414243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bb66b-f787-49d2-986f-d56f05d7be35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:44.502408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:44.520776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb66b-f787-49d2-986f-d56f05d7be35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:44.523496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bb66b-f787-49d2-986f-d56f05d7be35 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:44.552372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 831/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:45.798830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecc20-5f3b-4065-bdd5-021a3e51f576 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:45.799398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecc20-5f3b-4065-bdd5-021a3e51f576 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:45.799398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ecc20-5f3b-4065-bdd5-021a3e51f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:45.839106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d91ecc20-5f3b-4065-bdd5-021a3e51f576 None None] MFA Rules not processed for user `b030be7717f44bf1937ae3b548f7f81b`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:45.840432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d91ecc20-5f3b-4065-bdd5-021a3e51f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:45.962418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 813/1644] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:45.968549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f464a59-1957-44bc-8013-d70f5f8b19ae None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:45.969016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f464a59-1957-44bc-8013-d70f5f8b19ae None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:45.969098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f464a59-1957-44bc-8013-d70f5f8b19ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:45.992532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7f464a59-1957-44bc-8013-d70f5f8b19ae None None] MFA Rules not processed for user `b030be7717f44bf1937ae3b548f7f81b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:45.993996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7f464a59-1957-44bc-8013-d70f5f8b19ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:46.002631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 832/1645] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:46.074745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216dd71-8861-495e-afe2-0d80f52dc02c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:46.075196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216dd71-8861-495e-afe2-0d80f52dc02c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:46.075561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216dd71-8861-495e-afe2-0d80f52dc02c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:46.077026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 814/1646] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jun 29 11:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:17:46.097562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b2717-72ec-48f6-8a43-a952e73f53f0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:46.098016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b2717-72ec-48f6-8a43-a952e73f53f0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:46.098437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b2717-72ec-48f6-8a43-a952e73f53f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:46.142474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4c8b2717-72ec-48f6-8a43-a952e73f53f0 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:46.145041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4c8b2717-72ec-48f6-8a43-a952e73f53f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:46.328707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 833/1647] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jun 29 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:46.337577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216dd71-8861-495e-afe2-0d80f52dc02c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:46.353532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216dd71-8861-495e-afe2-0d80f52dc02c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:46.360564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e33f89-eba2-41a7-a5a8-061619a5dad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:46.361689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e33f89-eba2-41a7-a5a8-061619a5dad4 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:46.362367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e33f89-eba2-41a7-a5a8-061619a5dad4 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:46.362367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e33f89-eba2-41a7-a5a8-061619a5dad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:46.376311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e33f89-eba2-41a7-a5a8-061619a5dad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:46.379888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e33f89-eba2-41a7-a5a8-061619a5dad4 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:46.404832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 815/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:46.922420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73864a08-487c-431d-9e27-4a5ab2128196 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:46.922719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73864a08-487c-431d-9e27-4a5ab2128196 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:46.923007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73864a08-487c-431d-9e27-4a5ab2128196 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:46.925258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 834/1649] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jun 29 11:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:17:46.940010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:46.940464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:46.940707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:46.993533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:46.995786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:47.022265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 816/1650] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:17:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:47.037349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:47.038452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73864a08-487c-431d-9e27-4a5ab2128196 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:47.042821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:47.141629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317bbea-7130-4fa2-bdbc-1e0ba11970d6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:47.152165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f659f78-7cd2-4e92-aca0-57a1d87cf3aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:47.155012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f659f78-7cd2-4e92-aca0-57a1d87cf3aa service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:47.156016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f659f78-7cd2-4e92-aca0-57a1d87cf3aa service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:47.156318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f659f78-7cd2-4e92-aca0-57a1d87cf3aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:47.199533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f659f78-7cd2-4e92-aca0-57a1d87cf3aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:47.204677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f659f78-7cd2-4e92-aca0-57a1d87cf3aa service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:47.227755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73864a08-487c-431d-9e27-4a5ab2128196 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:47.237611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 817/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:47.239688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:47.240707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:47.241127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:47.241514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] PATH_INFO: `/v3/users/f86bda6a4b2c43259a663a6ae2f9db8f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:47.243798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86bda6a4b2c43259a663a6ae2f9db8f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:47.244947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: WARNING py.warnings [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:47.244947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: warnings.warn(msg) Jun 29 11:17:47.244947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: Jun 29 11:17:47.246436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:47.417343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86bda6a4b2c43259a663a6ae2f9db8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:47.424482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86bda6a4b2c43259a663a6ae2f9db8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:47.425386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86bda6a4b2c43259a663a6ae2f9db8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:47.453918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86bda6a4b2c43259a663a6ae2f9db8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:47.454788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86bda6a4b2c43259a663a6ae2f9db8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:47.459848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:47.479238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 835/1652] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:17:47 2022] DELETE /identity/v3/users/f86bda6a4b2c43259a663a6ae2f9db8f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:47.485426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702903-57fb-4cc7-92d1-ebcb94618e59 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:47.485934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702903-57fb-4cc7-92d1-ebcb94618e59 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:47.486352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50702903-57fb-4cc7-92d1-ebcb94618e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:47.510483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-50702903-57fb-4cc7-92d1-ebcb94618e59 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:47.512646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50702903-57fb-4cc7-92d1-ebcb94618e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:47.559377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:47.600426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 818/1653] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:47.656594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:47.658801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:47.816458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81495945-5a67-42de-9d4b-87121ddcddb8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:47.827197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508160db-978b-4a32-8977-d234a5e24bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:47.827879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508160db-978b-4a32-8977-d234a5e24bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:47.828167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508160db-978b-4a32-8977-d234a5e24bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:47.828899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508160db-978b-4a32-8977-d234a5e24bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:47.848924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508160db-978b-4a32-8977-d234a5e24bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:47.861585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508160db-978b-4a32-8977-d234a5e24bd8 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:47.902858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 836/1654] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:49.116010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a40f-b6f8-4f74-af70-190238e9fb57 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:49.116937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a40f-b6f8-4f74-af70-190238e9fb57 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:49.117475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a40f-b6f8-4f74-af70-190238e9fb57 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:49.121369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 819/1655] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jun 29 11:17:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:17:49.131670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:49.132725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:49.133358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:49.196028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a40f-b6f8-4f74-af70-190238e9fb57 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:49.199349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9f61a40f-b6f8-4f74-af70-190238e9fb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:49.240763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a40f-b6f8-4f74-af70-190238e9fb57 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:49.244290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:49.245443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:49.256420 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:49.257572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:49.258079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:49.258624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] PATH_INFO: `/v3/projects/f147641fd5844427b89cf4f1bafdda91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:49.264141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f147641fd5844427b89cf4f1bafdda91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:49.265209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 11:17:49.265209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jun 29 11:17:49.265209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: Jun 29 11:17:49.269156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:49.275647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 837/1656] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:17:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:17:49.346750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:49.363017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53406f12-b21b-4296-86d4-555bb9bc7d32 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:49.384538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:49.385218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:49.385506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:49.385786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:49.410975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:49.412384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:49.450685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f147641fd5844427b89cf4f1bafdda91', 'request_id': 'req-9a27b3f7-46d8-4ea1-88ba-9165099159bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.456647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 838/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:17:49.474244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f147641fd5844427b89cf4f1bafdda91', 'request_id': 'req-9a27b3f7-46d8-4ea1-88ba-9165099159bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.512211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f147641fd5844427b89cf4f1bafdda91', 'request_id': 'req-9a27b3f7-46d8-4ea1-88ba-9165099159bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.553676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] The token cache is being invalidate because project f147641fd5844427b89cf4f1bafdda91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:17:49.553977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.554704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.557324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 820/1658] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:17:49 2022] DELETE /identity/v3/projects/f147641fd5844427b89cf4f1bafdda91 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:49.561443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:49.582341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eefdc3-6a73-45b2-a2d6-69b8aa28d54f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:49.744308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:49.745219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:49.745507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:49.745788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] PATH_INFO: `/v3/users/3eb3b1edfedf4a6a89539b2fd4fa0e1d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:49.747064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb3b1edfedf4a6a89539b2fd4fa0e1d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:49.748999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:49.886547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb3b1edfedf4a6a89539b2fd4fa0e1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.908010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb3b1edfedf4a6a89539b2fd4fa0e1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.909082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb3b1edfedf4a6a89539b2fd4fa0e1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.921102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:49.957251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb3b1edfedf4a6a89539b2fd4fa0e1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.958090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-367f8b43-b485-46f4-a16d-265211885152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb3b1edfedf4a6a89539b2fd4fa0e1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:49.985073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 839/1659] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:17:49 2022] DELETE /identity/v3/users/3eb3b1edfedf4a6a89539b2fd4fa0e1d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:50.013719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:50.017803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:50.067064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27b3f7-46d8-4ea1-88ba-9165099159bc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:50.283765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:50.284733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:50.285018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:50.285294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] PATH_INFO: `/v3/users/fbe1be41bdcf4c62a0988185b699fa97` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:50.286716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe1be41bdcf4c62a0988185b699fa97)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:50.293557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:50.424229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe1be41bdcf4c62a0988185b699fa97'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:50.443242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe1be41bdcf4c62a0988185b699fa97'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:50.448861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:50.485372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe1be41bdcf4c62a0988185b699fa97'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:50.488378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe1be41bdcf4c62a0988185b699fa97'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:50.509438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe1be41bdcf4c62a0988185b699fa97'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:50.520693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 821/1660] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:17:50 2022] DELETE /identity/v3/users/fbe1be41bdcf4c62a0988185b699fa97 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:50.522380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42db91-7dba-44ab-af23-8c240ab8f545 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:50.522851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42db91-7dba-44ab-af23-8c240ab8f545 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:50.523146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42db91-7dba-44ab-af23-8c240ab8f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:50.558169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1e42db91-7dba-44ab-af23-8c240ab8f545 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:50.560004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1e42db91-7dba-44ab-af23-8c240ab8f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:50.763738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 840/1661] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:17:50.895468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:50.899259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:51.083406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6cd21-06e3-44a1-b5cb-9a45bd5e9e2e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:51.110759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78da85-231b-45d0-bafb-5a232c0d25b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:51.111783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78da85-231b-45d0-bafb-5a232c0d25b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:51.113512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78da85-231b-45d0-bafb-5a232c0d25b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:51.115289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78da85-231b-45d0-bafb-5a232c0d25b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:51.159978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78da85-231b-45d0-bafb-5a232c0d25b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:51.162290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78da85-231b-45d0-bafb-5a232c0d25b3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:51.194009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 822/1662] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:51.949485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cdba3-f890-4058-a6d9-a5ced7e57b5d None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:51.950277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cdba3-f890-4058-a6d9-a5ced7e57b5d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:51.950704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7cdba3-f890-4058-a6d9-a5ced7e57b5d None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:51.952666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 841/1663] 10.222.0.48 () {54 vars in 960 bytes} [Wed Jun 29 11:17:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:17:51.965681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e9e1-4a6e-4e6e-93aa-a46599f57748 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:51.966158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e9e1-4a6e-4e6e-93aa-a46599f57748 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:51.966302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e9e1-4a6e-4e6e-93aa-a46599f57748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:52.038124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6a55e9e1-4a6e-4e6e-93aa-a46599f57748 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:52.039492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a55e9e1-4a6e-4e6e-93aa-a46599f57748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:52.150154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 823/1664] 10.222.0.48 () {58 vars in 1057 bytes} [Wed Jun 29 11:17:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:52.162504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cdba3-f890-4058-a6d9-a5ced7e57b5d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:52.193419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7cdba3-f890-4058-a6d9-a5ced7e57b5d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:52.209632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:52.210604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:52.211133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:52.211689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:52.224749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:52.248553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:52.250313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb4eac-2d1a-4224-a3d0-d421ca0cc895 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:52.283261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 842/1665] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:52.471387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa353d7-98f3-4247-92f8-3e8439522cbb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:52.471717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa353d7-98f3-4247-92f8-3e8439522cbb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:52.472599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa353d7-98f3-4247-92f8-3e8439522cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:52.493098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147a1a-e288-4747-aee8-fe05115a5e37 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:52.493402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147a1a-e288-4747-aee8-fe05115a5e37 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:52.493761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2147a1a-e288-4747-aee8-fe05115a5e37 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:52.496347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 843/1666] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jun 29 11:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:17:52.528881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:52.529492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:52.529926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:52.552906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bfa353d7-98f3-4247-92f8-3e8439522cbb None None] MFA Rules not processed for user `fb03aabb4dfe4e17bf12831cc5824612`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:52.553812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bfa353d7-98f3-4247-92f8-3e8439522cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:52.583268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:52.589328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:52.828353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 844/1667] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jun 29 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 29 11:17:52.831932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:52.837705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:52.870765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4918f9-e5eb-4f89-a588-1cfcef101021 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:52.892902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:52.896829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:52.897135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:52.897488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] PATH_INFO: `/v3/projects/b3df7f551eff4adbb5aedbd7a13d3b1c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:52.902070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3df7f551eff4adbb5aedbd7a13d3b1c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:52.908618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:53.032721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3df7f551eff4adbb5aedbd7a13d3b1c', 'request_id': 'req-03d18eb2-a38a-40a9-820a-9c76c6879277'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.039695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:53.052443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3df7f551eff4adbb5aedbd7a13d3b1c', 'request_id': 'req-03d18eb2-a38a-40a9-820a-9c76c6879277'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.069500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3df7f551eff4adbb5aedbd7a13d3b1c', 'request_id': 'req-03d18eb2-a38a-40a9-820a-9c76c6879277'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.101078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] The token cache is being invalidate because project b3df7f551eff4adbb5aedbd7a13d3b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:17:53.101484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.102550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-03d18eb2-a38a-40a9-820a-9c76c6879277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.105422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 845/1668] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:17:52 2022] DELETE /identity/v3/projects/b3df7f551eff4adbb5aedbd7a13d3b1c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:53.111801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23038-8d9a-46c9-a061-cdebd1e06ca4 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.112238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23038-8d9a-46c9-a061-cdebd1e06ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.113123 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea23038-8d9a-46c9-a061-cdebd1e06ca4 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.114685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 846/1669] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jun 29 11:17:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:17:53.136419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 824/1670] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 666 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:53.143309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b403-d19f-4233-8435-2b76b60fd1bc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.144050 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b403-d19f-4233-8435-2b76b60fd1bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.144702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b403-d19f-4233-8435-2b76b60fd1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.151068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23038-8d9a-46c9-a061-cdebd1e06ca4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:53.156414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:53.162235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bea23038-8d9a-46c9-a061-cdebd1e06ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.197268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8aa3b403-d19f-4233-8435-2b76b60fd1bc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:53.214553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8aa3b403-d19f-4233-8435-2b76b60fd1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.367747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea23038-8d9a-46c9-a061-cdebd1e06ca4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:53.370192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 825/1671] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:53.371016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.371437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.371870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.383860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:53.384753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.385042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.385320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] PATH_INFO: `/v3/projects/db45afc3940b4337967303a4338e097a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.387973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db45afc3940b4337967303a4338e097a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:53.397186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:53.408597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:53.414332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.505313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db45afc3940b4337967303a4338e097a', 'request_id': 'req-9c58ea35-961b-42dd-9d92-d1934d578c1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.545790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db45afc3940b4337967303a4338e097a', 'request_id': 'req-9c58ea35-961b-42dd-9d92-d1934d578c1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.568791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db45afc3940b4337967303a4338e097a', 'request_id': 'req-9c58ea35-961b-42dd-9d92-d1934d578c1d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.570753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 826/1672] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:53.571765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:53.577231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.601298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] The token cache is being invalidate because project db45afc3940b4337967303a4338e097a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:17:53.601621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.604921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9c58ea35-961b-42dd-9d92-d1934d578c1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:53.605260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e19891-e984-432a-bf51-b0b2a15dd822 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:53.610535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 847/1673] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:17:53 2022] DELETE /identity/v3/projects/db45afc3940b4337967303a4338e097a => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:53.616469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.617056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.617346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.664763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:53.667703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.732699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:53.733623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.734117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.734603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.742995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.795021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 848/1674] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:53.796402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:53.799515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:53.827352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b2bc2-61cd-44ec-b7fe-66a638ad4151 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:53.852385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:53.853317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:53.853726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:53.854409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] PATH_INFO: `/v3/users/bc7562ee6b344bdebac0007d24dc2785` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:53.858508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7562ee6b344bdebac0007d24dc2785)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:53.865920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:53.866688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:53.886491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:53.940823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:53.947411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:53.970230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 827/1675] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:53.971131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:53.973078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:54.051055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7562ee6b344bdebac0007d24dc2785'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:54.072683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7562ee6b344bdebac0007d24dc2785'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:54.075452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7562ee6b344bdebac0007d24dc2785'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:54.119274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7562ee6b344bdebac0007d24dc2785'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:54.119982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7562ee6b344bdebac0007d24dc2785'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:54.125248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94465e-5ade-4605-ad00-68f200f19396 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:54.139664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:54.140442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:54.140798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:54.141143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:54.146318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:54.174075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 849/1676] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:17:53 2022] DELETE /identity/v3/users/bc7562ee6b344bdebac0007d24dc2785 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:54.174075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:54.177934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:54.199391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:54.204368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:54.257797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 828/1677] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:54.394862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1160-4834-45ab-8d25-1ac146d389b7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:54.417636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:54.418331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:54.418617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:54.418901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:54.419759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:17:54.419978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:54.421588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:54.448242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 850/1678] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:17:54.452744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:54.475167 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a619c1b-2e19-4672-8e16-553fa70a0c1c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:54.495878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:54.496708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:54.497003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:54.497310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:54.498064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:54.510608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:54.594539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 829/1679] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:54 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:54.598605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:54.612903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f9133-c4a1-48c8-a152-f8148d6d2c54 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:54.795863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:54.796618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:54.796993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:54.797446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:54.798199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:54.801047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:54.880988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 851/1680] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:54 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:17:54.885120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:54.900650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6717b1-83d4-452b-94f9-7010f8af7b50 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:54.915459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:54.916592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:54.917482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:54.917960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:54.918950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:54.922160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:54.939492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 830/1681] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:54.943713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:54.963987 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ddd41-63f9-4fbb-814f-d4ddd6bdc2f4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:54.970295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11374e-83c2-4215-ad54-e59f04341101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:54.970991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11374e-83c2-4215-ad54-e59f04341101 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:54.971314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11374e-83c2-4215-ad54-e59f04341101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:54.971598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11374e-83c2-4215-ad54-e59f04341101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:54.973600 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11374e-83c2-4215-ad54-e59f04341101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:54.975280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11374e-83c2-4215-ad54-e59f04341101 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:55.031537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:55.065542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 852/1682] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:55.067353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:55.084284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32e094-c6f1-45f3-a455-056b08a175f8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:55.102337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:55.104745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:55.104745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:55.104745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] PATH_INFO: `/v3/projects/e224c413ab7f44e48ff632133064acae/users/8a1c49fa5cc24fd69884771f0746e04b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:55.149109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e224c413ab7f44e48ff632133064acae, user_id=8a1c49fa5cc24fd69884771f0746e04b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:55.151942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:55.196049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 831/1683] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:55 2022] PUT /identity/v3/projects/e224c413ab7f44e48ff632133064acae/users/8a1c49fa5cc24fd69884771f0746e04b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:55.208486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:55.209006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:55.209423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:55.277393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] MFA Rules not processed for user `8a1c49fa5cc24fd69884771f0746e04b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:55.279108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:55.433186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 853/1684] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:55.437817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:55.646606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237105-e035-41bf-92b6-b76e71fbd253 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:55.664181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:55.665531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:55.665756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:55.666044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:55.666755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:55.671062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:55.754002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 832/1685] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:17:55.757954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:55.776248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2cc3a-5454-49e2-bafd-6c294c59a45a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:55.968405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:55.969351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:55.969908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:55.969908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:55.970859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:55.976293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:56.045614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:56.046528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 854/1686] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:17:55 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:17:56.063088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:56.069125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceee0e9-5ffc-422c-a169-a20d2ea6780b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:56.088381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535293f-c0d9-419e-be94-b376f4e7b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:56.089080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535293f-c0d9-419e-be94-b376f4e7b2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.089369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535293f-c0d9-419e-be94-b376f4e7b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.089651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535293f-c0d9-419e-be94-b376f4e7b2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.090392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535293f-c0d9-419e-be94-b376f4e7b2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:56.105515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535293f-c0d9-419e-be94-b376f4e7b2ae admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:56.167394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:56.173772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 833/1687] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:56.180736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d892238-34de-4275-aa63-ee51a1c39024 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:56.191457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:56.193807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.194104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.194393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] PATH_INFO: `/v3/projects/f56c607bf14241bbba746eeab0747b0c/users/b58f69f483c743acb2ed0ece8dd015f5/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.214523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e371-5987-41af-b03c-32993a010f2d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.214820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e371-5987-41af-b03c-32993a010f2d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.215130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e371-5987-41af-b03c-32993a010f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.222213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56c607bf14241bbba746eeab0747b0c, user_id=b58f69f483c743acb2ed0ece8dd015f5, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:56.225575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:56.255019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 855/1688] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:56 2022] PUT /identity/v3/projects/f56c607bf14241bbba746eeab0747b0c/users/b58f69f483c743acb2ed0ece8dd015f5/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:56.258951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:56.274589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a204e371-5987-41af-b03c-32993a010f2d None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:56.275872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a204e371-5987-41af-b03c-32993a010f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:56.420918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:56.433099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 834/1689] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:17:56.443670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad7fe-1992-472c-8555-7deddb7d2196 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:56.472832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b969b0b-b597-40dc-8d7d-1cf361ca3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:56.473669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b969b0b-b597-40dc-8d7d-1cf361ca3091 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.473964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b969b0b-b597-40dc-8d7d-1cf361ca3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.474252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b969b0b-b597-40dc-8d7d-1cf361ca3091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.475177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b969b0b-b597-40dc-8d7d-1cf361ca3091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:56.476788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b969b0b-b597-40dc-8d7d-1cf361ca3091 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:56.509173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 856/1690] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:17:56.513604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204e371-5987-41af-b03c-32993a010f2d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:56.535648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204e371-5987-41af-b03c-32993a010f2d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:56.551715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:56.552630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.552918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.553199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] PATH_INFO: `/v3/projects/f56c607bf14241bbba746eeab0747b0c/users/b58f69f483c743acb2ed0ece8dd015f5/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.559949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56c607bf14241bbba746eeab0747b0c, user_id=b58f69f483c743acb2ed0ece8dd015f5, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:56.562632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:56.599057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 835/1691] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:17:56 2022] PUT /identity/v3/projects/f56c607bf14241bbba746eeab0747b0c/users/b58f69f483c743acb2ed0ece8dd015f5/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:56.600532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.600832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.601243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.646860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] MFA Rules not processed for user `b58f69f483c743acb2ed0ece8dd015f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:56.649025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:56.734459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:56.737083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:56.780850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 857/1692] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:56.792060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:56.794237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:56.866490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60334-2b91-4be3-8a46-01b7742981e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:56.887073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:56.888144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.888619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.891146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.927116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90019c3e-84e2-4470-a0da-11ccc30de993 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:56.935177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1898da-7b77-4101-a0f7-9b9247deacba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:56.936231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1898da-7b77-4101-a0f7-9b9247deacba service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:56.937502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1898da-7b77-4101-a0f7-9b9247deacba service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:56.938990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1898da-7b77-4101-a0f7-9b9247deacba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:56.960352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1898da-7b77-4101-a0f7-9b9247deacba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:56.962130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1898da-7b77-4101-a0f7-9b9247deacba service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:56.990112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 858/1693] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:17:57.037142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:57.041384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:57.075898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 836/1694] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:17:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:17:58.693834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486cf3-058f-436e-8e55-e6eaafbc45ea None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:58.694440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486cf3-058f-436e-8e55-e6eaafbc45ea None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:58.694440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486cf3-058f-436e-8e55-e6eaafbc45ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:58.825892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-10486cf3-058f-436e-8e55-e6eaafbc45ea None None] MFA Rules not processed for user `eb03b2aff9674231b7275a12171a3197`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:58.841756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-10486cf3-058f-436e-8e55-e6eaafbc45ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:58.991980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:59.097215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 859/1695] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:17:59.101021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:59.101344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:59.104020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:59.132362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:59.170224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:17:59.193687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] MFA Rules not processed for user `eb03b2aff9674231b7275a12171a3197`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:59.197066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:59.219910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 860/1696] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:17:59.235343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:17:59.237142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:17:59.300455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae460ef-bf78-4ba1-ab00-ae5194d66c2c service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:59.322281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:59.323968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:59.324269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:59.324948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] PATH_INFO: `/v3/users/8a1c49fa5cc24fd69884771f0746e04b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:59.331928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1c49fa5cc24fd69884771f0746e04b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:59.345489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:59.349571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50262ff4-3165-4cbf-a9cf-88d5b96b93d0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:17:59.364564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a609ca-78a7-4aa8-bfe7-ebd1ac1d1fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:17:59.365762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a609ca-78a7-4aa8-bfe7-ebd1ac1d1fae service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:59.366211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a609ca-78a7-4aa8-bfe7-ebd1ac1d1fae service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:59.366651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a609ca-78a7-4aa8-bfe7-ebd1ac1d1fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:59.391165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a609ca-78a7-4aa8-bfe7-ebd1ac1d1fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:17:59.396416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a609ca-78a7-4aa8-bfe7-ebd1ac1d1fae service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:17:59.423980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 861/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:17:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:17:59.530969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1c49fa5cc24fd69884771f0746e04b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:59.548674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1c49fa5cc24fd69884771f0746e04b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:59.619306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1c49fa5cc24fd69884771f0746e04b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:59.622293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1c49fa5cc24fd69884771f0746e04b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:59.664340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1c49fa5cc24fd69884771f0746e04b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:17:59.693396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 837/1698] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:17:58 2022] DELETE /identity/v3/users/8a1c49fa5cc24fd69884771f0746e04b => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:17:59.696105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:17:59.696662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:17:59.696662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:17:59.726146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:17:59.732448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:00.317093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 862/1699] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:00.370676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:00.373027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:00.591383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931c730-25d8-43fb-b45e-3c4b15a0cbe0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:00.606254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf0969-8ba5-41af-8685-beafd5229939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:00.609479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0969-8ba5-41af-8685-beafd5229939 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:00.609479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0969-8ba5-41af-8685-beafd5229939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:00.609479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf0969-8ba5-41af-8685-beafd5229939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:00.639186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0969-8ba5-41af-8685-beafd5229939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:00.641045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf0969-8ba5-41af-8685-beafd5229939 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:00.680325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 838/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:01.250538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:01.253334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:01.278740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29558c31-4da6-4be9-b616-0db132d0991b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:01.292642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:01.293790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:01.294228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:01.294658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] PATH_INFO: `/v3/projects/9e99ffc3eb5a41b6bbfb96e1b2fca0a4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:01.302282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e99ffc3eb5a41b6bbfb96e1b2fca0a4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:01.304577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:01.445146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e99ffc3eb5a41b6bbfb96e1b2fca0a4', 'request_id': 'req-bec59a2a-2642-4d59-902f-df1af0e68d7e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:01.466534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e99ffc3eb5a41b6bbfb96e1b2fca0a4', 'request_id': 'req-bec59a2a-2642-4d59-902f-df1af0e68d7e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:01.474349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6547-1c8c-4507-9213-5461785953d1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:01.475447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6547-1c8c-4507-9213-5461785953d1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:01.476535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf6547-1c8c-4507-9213-5461785953d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:01.485423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e99ffc3eb5a41b6bbfb96e1b2fca0a4', 'request_id': 'req-bec59a2a-2642-4d59-902f-df1af0e68d7e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:01.532652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] The token cache is being invalidate because project 9e99ffc3eb5a41b6bbfb96e1b2fca0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:01.533294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:01.534237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec59a2a-2642-4d59-902f-df1af0e68d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:01.536756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 863/1701] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:01 2022] DELETE /identity/v3/projects/9e99ffc3eb5a41b6bbfb96e1b2fca0a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:01.542207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:01.543162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:01.543684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:01.550688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-46cf6547-1c8c-4507-9213-5461785953d1 None None] MFA Rules not processed for user `fb03aabb4dfe4e17bf12831cc5824612`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:01.554557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-46cf6547-1c8c-4507-9213-5461785953d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:01.606985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:01.608527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:01.621845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:01.743464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:01.771917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 839/1702] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:01.858020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 864/1703] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:01.866051 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:01.866351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:01.866639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:01.948159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:01.949478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:01.992570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:01.992794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 840/1704] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:02.021657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6012e-c295-4344-8320-0cd0ed05403f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:02.052646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:02.053929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.054224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.054560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.055347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:02.055759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:02.058712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9762b-37e7-4f33-a57d-8091462b111c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:02.126728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:02.143237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 865/1705] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:02.145828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538a494-973b-4dd3-9cae-84572fcc68fc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:02.177031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:02.177728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.178072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.178376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.179108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:02.181047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:02.271914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 841/1706] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:02 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:02.275799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.276365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:02.276444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.276444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.352655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:02.353891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:02.443325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a7aacd-a535-4098-acc6-0d289dd98be0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:02.463429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98fe6e-42bb-4df3-b538-6ce7996a55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:02.464235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fe6e-42bb-4df3-b538-6ce7996a55bb admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.464531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fe6e-42bb-4df3-b538-6ce7996a55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.464819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98fe6e-42bb-4df3-b538-6ce7996a55bb admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.465926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98fe6e-42bb-4df3-b538-6ce7996a55bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:02.476630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98fe6e-42bb-4df3-b538-6ce7996a55bb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:02.555603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 842/1707] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:02 2022] POST /identity/v3/users => generated 300 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:02.562877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.563243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.563527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.569924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 866/1708] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Jun 29 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:02.573323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:02.608089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566b197-b0ff-40d3-a829-50ed5207f3ca None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:02.643934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:02.649681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] MFA Rules not processed for user `acee9273e0714017bb29bbc578847b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:02.654187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:02.661699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.661995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.662277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.663101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:02.664686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:02.704948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 867/1709] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:02.705818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:02.712966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:02.763136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9c96-33da-4109-9cb0-20a58563278e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:02.793997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:02.798676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.800351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.801019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.839700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:02.851466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:02.895268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 868/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:02.896157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:02.947199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd49867-c478-4376-a6f1-b3e952203e2b service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:02.963426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661947f6-61fc-4dbb-b1cf-c16d6e620fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:02.964105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661947f6-61fc-4dbb-b1cf-c16d6e620fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:02.964340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661947f6-61fc-4dbb-b1cf-c16d6e620fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:02.964622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661947f6-61fc-4dbb-b1cf-c16d6e620fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:02.965361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661947f6-61fc-4dbb-b1cf-c16d6e620fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:02.966964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661947f6-61fc-4dbb-b1cf-c16d6e620fd9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:02.973109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 843/1711] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:03.015526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 869/1712] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:03.020012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:03.038226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77256b-160d-4c26-8208-6c10a967de68 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:03.055547 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:03.060313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:03.060680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:03.061032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] PATH_INFO: `/v3/projects/8e85e55d4954429ea25e5c00b6415434/users/dfe9fb1e725043ffaec89d9b73bf6cf3/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:03.114290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e85e55d4954429ea25e5c00b6415434, user_id=dfe9fb1e725043ffaec89d9b73bf6cf3, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:03.121011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:03.174346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 844/1713] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:03 2022] PUT /identity/v3/projects/8e85e55d4954429ea25e5c00b6415434/users/dfe9fb1e725043ffaec89d9b73bf6cf3/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:03.189448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b987c-c204-4f6c-b8ff-61c65b529c5a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:03.189755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b987c-c204-4f6c-b8ff-61c65b529c5a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:03.190020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b987c-c204-4f6c-b8ff-61c65b529c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:03.257414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-543b987c-c204-4f6c-b8ff-61c65b529c5a None None] MFA Rules not processed for user `dfe9fb1e725043ffaec89d9b73bf6cf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:03.258699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-543b987c-c204-4f6c-b8ff-61c65b529c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:03.476073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:03.500429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:03.505088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:03.505952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 870/1714] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:03.507626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:03.508251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:03.508742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:03.568217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] MFA Rules not processed for user `eb03b2aff9674231b7275a12171a3197`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:03.569471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:03.570503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:03.729171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc022ec-86bb-40b0-a773-77f0ae0e8715 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:03.775463 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acae891-1460-4f4a-941b-7475d38c83ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:03.776200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae891-1460-4f4a-941b-7475d38c83ba service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:03.776514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae891-1460-4f4a-941b-7475d38c83ba service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:03.776822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acae891-1460-4f4a-941b-7475d38c83ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:03.841606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 871/1715] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:03.846789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:04.018015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae891-1460-4f4a-941b-7475d38c83ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:04.023468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acae891-1460-4f4a-941b-7475d38c83ba service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:04.071732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 845/1716] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:04.073150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:04.073449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:04.073734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:04.108175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a50d1f-b219-4307-9f64-ae1fb98363c5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:04.125046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:04.126238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:04.128618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:04.128925 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:04.129712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:04.130870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:04.135146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:04.136490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:04.205447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 872/1717] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:03 2022] POST /identity/v3/projects => generated 399 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:04.213102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:04.330364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 846/1718] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:04.351918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:04.356306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:04.393985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9383b-f720-4604-8662-bfc0f4fc6c06 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:04.474790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd440f-8785-477e-99e8-20d2e415e2db admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:04.497354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:04.502223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:04.506229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:04.507194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:04.513430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:04.523876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:04.567237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:04.568579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:04.568811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:04.569100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:04.601002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:04.604229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:04.608686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 873/1719] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:04 2022] POST /identity/v3/users => generated 306 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:04.613303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:04.652246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 847/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:04.660249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f93ef6-8905-49e2-b6c0-ed70fb13b7c8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:04.675855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:04.676558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:04.676852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:04.679494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:04.681120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:04.684712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:04.717676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 874/1721] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:04.718887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:04.739674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1320c-2978-472b-b8d4-6b713ff65662 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:04.761177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:04.762087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:04.762368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:04.762642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] PATH_INFO: `/v3/projects/a21dde35668545e1bfdf1a377da45d49/users/dd26498843db402d8654dd6690c63ff6/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:04.775303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:04.823895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21dde35668545e1bfdf1a377da45d49, user_id=dd26498843db402d8654dd6690c63ff6, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:04.827480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:04.860679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 848/1722] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:04 2022] PUT /identity/v3/projects/a21dde35668545e1bfdf1a377da45d49/users/dd26498843db402d8654dd6690c63ff6/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:04.866848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:04.880597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d02cf-c418-451e-ac8b-007702f8c66c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:04.901557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:05.075864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f986ec1-41bf-4896-bf13-1e105a0da676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:05.078617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986ec1-41bf-4896-bf13-1e105a0da676 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:05.078912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986ec1-41bf-4896-bf13-1e105a0da676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:05.079308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f986ec1-41bf-4896-bf13-1e105a0da676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:05.082450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986ec1-41bf-4896-bf13-1e105a0da676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:05.084462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f986ec1-41bf-4896-bf13-1e105a0da676 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:05.103720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 875/1723] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:05.107553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:05.128500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad44207-43bd-46b2-864c-cd9eecd1c82c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:05.135947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:05.137829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:05.138453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:05.139242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] PATH_INFO: `/v3/projects/a21dde35668545e1bfdf1a377da45d49/users/dd26498843db402d8654dd6690c63ff6/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:05.144354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21dde35668545e1bfdf1a377da45d49, user_id=dd26498843db402d8654dd6690c63ff6, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:05.150693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:05.193701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 849/1724] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:05 2022] PUT /identity/v3/projects/a21dde35668545e1bfdf1a377da45d49/users/dd26498843db402d8654dd6690c63ff6/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:05.204448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:05.205117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:05.205627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:05.307177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] MFA Rules not processed for user `dd26498843db402d8654dd6690c63ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:05.308776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:05.446690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:05.449346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:05.664003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 876/1725] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:05.673250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:05.675458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:05.738980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72d60-0aa2-484c-a6ca-dfb03a74279b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:05.758974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:05.759962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:05.760249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:05.760565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] PATH_INFO: `/v3/projects/e224c413ab7f44e48ff632133064acae` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:05.761873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e224c413ab7f44e48ff632133064acae)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:05.764461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:05.811809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45a57-4ae2-403c-8000-a0ad6858036e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:05.818802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:05.819952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:05.820325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:05.820827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:05.844937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:05.849699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:05.872820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e224c413ab7f44e48ff632133064acae', 'request_id': 'req-c951f9df-924f-419b-8106-a3a5d95d13b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:05.880782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 877/1726] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:05.887880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e224c413ab7f44e48ff632133064acae', 'request_id': 'req-c951f9df-924f-419b-8106-a3a5d95d13b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:05.898925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e224c413ab7f44e48ff632133064acae', 'request_id': 'req-c951f9df-924f-419b-8106-a3a5d95d13b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:05.932113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] The token cache is being invalidate because project e224c413ab7f44e48ff632133064acae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:05.932415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:05.937314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:05.958444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 850/1727] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:05 2022] DELETE /identity/v3/projects/e224c413ab7f44e48ff632133064acae => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:05.962763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:05.992715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d582af-063a-420e-b795-cf4d4ab03b35 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:06.050844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:06.054153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:06.116295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:06.227774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:06.230533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:06.257951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:06.258994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] PATH_INFO: `/v3/users/b58f69f483c743acb2ed0ece8dd015f5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:06.267901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58f69f483c743acb2ed0ece8dd015f5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:06.288500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:06.314891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951f9df-924f-419b-8106-a3a5d95d13b8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:06.353891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:06.360111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:06.361046 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:06.363378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:06.368780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:06.411578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:06.492031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58f69f483c743acb2ed0ece8dd015f5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:06.521937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58f69f483c743acb2ed0ece8dd015f5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:06.522808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58f69f483c743acb2ed0ece8dd015f5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:06.553624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:06.556327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2cb64e-16f5-4121-935e-a09e42421fa1 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:06.566385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58f69f483c743acb2ed0ece8dd015f5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:06.573295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58f69f483c743acb2ed0ece8dd015f5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:06.595396 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 851/1728] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:06.607831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74c0f-2ca8-48f1-829f-312292658d54 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:06.607831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74c0f-2ca8-48f1-829f-312292658d54 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:06.607831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74c0f-2ca8-48f1-829f-312292658d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:06.661763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 878/1729] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:05 2022] DELETE /identity/v3/users/b58f69f483c743acb2ed0ece8dd015f5 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:06.692927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-88a74c0f-2ca8-48f1-829f-312292658d54 None None] MFA Rules not processed for user `2ab3cbf49f514ba0bc7cf2e387f4933f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:06.694246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-88a74c0f-2ca8-48f1-829f-312292658d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:06.987022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 852/1730] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:07.328818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:07.331074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:07.683673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e27c57-6a34-4f64-b1a5-1f0a493d663b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:07.700302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac7ca6-472e-4285-bcb7-5e41fdcf44c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:07.701574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7ca6-472e-4285-bcb7-5e41fdcf44c2 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:07.704754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7ca6-472e-4285-bcb7-5e41fdcf44c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:07.704754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac7ca6-472e-4285-bcb7-5e41fdcf44c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:07.726462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7ca6-472e-4285-bcb7-5e41fdcf44c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:07.728327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac7ca6-472e-4285-bcb7-5e41fdcf44c2 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:07.761361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 879/1731] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:09.278361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675badd2-0a2f-4c68-9206-524bf1ccc729 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:09.278953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675badd2-0a2f-4c68-9206-524bf1ccc729 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:09.278953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675badd2-0a2f-4c68-9206-524bf1ccc729 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:09.289843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 853/1732] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:18:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:18:09.373417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:09.374004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:09.374004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:09.457791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:09.466357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:09.514821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 880/1733] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:18:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:10.297320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675badd2-0a2f-4c68-9206-524bf1ccc729 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:10.299389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-675badd2-0a2f-4c68-9206-524bf1ccc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:10.399364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675badd2-0a2f-4c68-9206-524bf1ccc729 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:10.455862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bce5d-95df-41d4-bbc0-dd5efdaf58ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:10.456756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bce5d-95df-41d4-bbc0-dd5efdaf58ae service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:10.457198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bce5d-95df-41d4-bbc0-dd5efdaf58ae service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:10.457638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bce5d-95df-41d4-bbc0-dd5efdaf58ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:10.499652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bce5d-95df-41d4-bbc0-dd5efdaf58ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:10.501394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bce5d-95df-41d4-bbc0-dd5efdaf58ae service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:10.543410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 854/1734] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:10.621814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:10.623587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:10.888951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:11.037281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f45db-bdf9-4f67-bc91-f5d279646546 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:11.076986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:11.078093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:11.088453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:11.088928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] PATH_INFO: `/v3/projects/f56c607bf14241bbba746eeab0747b0c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:11.091164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56c607bf14241bbba746eeab0747b0c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:11.097399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:11.388271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56c607bf14241bbba746eeab0747b0c', 'request_id': 'req-5014ae20-9382-4995-8fe4-4da4d7db218e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:11.414994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56c607bf14241bbba746eeab0747b0c', 'request_id': 'req-5014ae20-9382-4995-8fe4-4da4d7db218e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:11.445846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56c607bf14241bbba746eeab0747b0c', 'request_id': 'req-5014ae20-9382-4995-8fe4-4da4d7db218e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:11.489618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] The token cache is being invalidate because project f56c607bf14241bbba746eeab0747b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:11.490080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:11.490903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5014ae20-9382-4995-8fe4-4da4d7db218e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:11.498570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 881/1735] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:10 2022] DELETE /identity/v3/projects/f56c607bf14241bbba746eeab0747b0c => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:11.510428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:11.512756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:11.513211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:11.567938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:11.572103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:11.860373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 855/1736] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:11.870995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:11.872059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:11.872569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:11.934322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:11.939161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:11.999959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 882/1737] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:12.005095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:12.017666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66177b83-5ef4-45ca-9ba8-d400df973839 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:12.043752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:12.044753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.045154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.048465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.050247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:12.051427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:12.057052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:12.107825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:12.122217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 856/1738] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:18:12.125910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c976b1-e4d8-4483-bcb8-9fc09f0b2673 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:12.145947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:12.149000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.149477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.153918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.154881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:12.168311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:12.278626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 883/1739] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:12 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:12.283143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:12.297348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57003a56-9556-4bfb-b257-67cdc9d75fcc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:12.353610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:12.467741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:12.468437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.468903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.469339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.470197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:12.476800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:12.531682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:12.540057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 857/1740] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:12 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:12.550142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad791-53da-4468-a0cb-f0c63c24aaa9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:12.581239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:12.582480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.582981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.583487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.584500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:12.586560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:12.604307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 884/1741] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:12.608592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:12.625208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6e710-3eb2-4b34-ab65-c7584e6e8d0e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:12.641495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158d7b-9f74-403c-9bdf-5b4d1e62bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:12.642292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158d7b-9f74-403c-9bdf-5b4d1e62bd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.642653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158d7b-9f74-403c-9bdf-5b4d1e62bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.643173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158d7b-9f74-403c-9bdf-5b4d1e62bd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.644003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158d7b-9f74-403c-9bdf-5b4d1e62bd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:12.645836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158d7b-9f74-403c-9bdf-5b4d1e62bd41 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:12.677345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 858/1742] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:12.683294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:12.706054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e993c8d-f7a7-4d06-b92e-bd03d17ed908 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:12.723785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:12.725619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.726137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.726651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] PATH_INFO: `/v3/projects/b9936cc4b1074b5b9b44521f149306d4/users/aafab7de628f4249a5bf8cde4c1dbd77/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.762621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9936cc4b1074b5b9b44521f149306d4, user_id=aafab7de628f4249a5bf8cde4c1dbd77, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:12.766280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:12.794842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 885/1743] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:12 2022] PUT /identity/v3/projects/b9936cc4b1074b5b9b44521f149306d4/users/aafab7de628f4249a5bf8cde4c1dbd77/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:12.807990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:12.808483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:12.808771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:12.887301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] MFA Rules not processed for user `aafab7de628f4249a5bf8cde4c1dbd77`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:12.889842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:13.142971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 859/1744] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:13.145328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:13.301029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:13.306037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a2281-52ee-4665-b8ee-11a986996eed admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:13.313574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:13.315005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:13.315855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:13.316346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:13.317359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:13.320871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:13.370100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 886/1745] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:13 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:13.372395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:13.407851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2e690-1142-4b5b-8aff-ee4ac5b76d26 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:13.564153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:13.566208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:13.566654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:13.567192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:13.568320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:13.573430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:13.577148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:13.585212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:13.610899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c387b26-05b4-4fcd-b2dd-5473799a9fe8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:13.626702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:13.628238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:13.628763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:13.628906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] PATH_INFO: `/v3/users/dfe9fb1e725043ffaec89d9b73bf6cf3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:13.631417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe9fb1e725043ffaec89d9b73bf6cf3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:13.633159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:13.650688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 860/1746] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:13 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:13.654208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:13.678196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c1633-7205-4f53-a9a1-90a6f5da07e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:13.685356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:13.686571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:13.687012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:13.687473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:13.689107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:13.691970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:13.722908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 861/1747] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:13.728131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:13.746877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13f08-2245-4f7b-bf2a-09c97c4e4028 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:13.757130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:13.758512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:13.759080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:13.759799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] PATH_INFO: `/v3/projects/12d5595362044627869f04a312ebcb2d/users/6b8f3e08654e4c6692b9a5ac936eb6a4/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:13.764556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:13.796669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5595362044627869f04a312ebcb2d, user_id=6b8f3e08654e4c6692b9a5ac936eb6a4, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:13.800572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe9fb1e725043ffaec89d9b73bf6cf3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:13.802894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:13.822642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 862/1748] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:13 2022] PUT /identity/v3/projects/12d5595362044627869f04a312ebcb2d/users/6b8f3e08654e4c6692b9a5ac936eb6a4/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:13.832370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe9fb1e725043ffaec89d9b73bf6cf3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:13.835863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe9fb1e725043ffaec89d9b73bf6cf3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:13.841266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:13.849070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:13.874771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe9fb1e725043ffaec89d9b73bf6cf3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:13.875950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618f0098-85cd-43af-84b9-c3310094aae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe9fb1e725043ffaec89d9b73bf6cf3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:13.918649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 887/1749] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:13 2022] DELETE /identity/v3/users/dfe9fb1e725043ffaec89d9b73bf6cf3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:13.923985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272273-8e72-41c1-acf6-4c6088ab82f9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:13.925455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272273-8e72-41c1-acf6-4c6088ab82f9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:13.925896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272273-8e72-41c1-acf6-4c6088ab82f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:13.973444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7e21a-ebd2-40aa-ad27-01986feabf19 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:13.981785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-86272273-8e72-41c1-acf6-4c6088ab82f9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:13.983410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86272273-8e72-41c1-acf6-4c6088ab82f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:14.072108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:14.073515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:14.074080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:14.074369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:14.075260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:14.077762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:14.098257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 863/1750] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:14.099965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:14.117606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d19974-b6b5-4dfc-9645-6110aca9f1b7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:14.124351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:14.126200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:14.126496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:14.126778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] PATH_INFO: `/v3/projects/12d5595362044627869f04a312ebcb2d/users/6b8f3e08654e4c6692b9a5ac936eb6a4/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:14.130754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5595362044627869f04a312ebcb2d, user_id=6b8f3e08654e4c6692b9a5ac936eb6a4, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:14.134804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:14.156966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 888/1752] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:14.164057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 864/1752] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:14 2022] PUT /identity/v3/projects/12d5595362044627869f04a312ebcb2d/users/6b8f3e08654e4c6692b9a5ac936eb6a4/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:14.165345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:14.165632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:14.165953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:14.202148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:14.204689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:14.220063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] MFA Rules not processed for user `6b8f3e08654e4c6692b9a5ac936eb6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:14.221912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:14.313388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37d6c-1d2a-4bb7-9435-3746bf189a81 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:14.313968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:14.326200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:14.328069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:14.328069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:14.328069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:14.369765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 889/1753] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:14.382603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:14.384312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:14.411100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:14.516652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:14.518769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:14.531196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924bad6-e193-4adb-a7d1-e3d14a76b288 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:14.535171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77726309-0611-4d19-846c-97499e696216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:14.536817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77726309-0611-4d19-846c-97499e696216 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:14.537273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77726309-0611-4d19-846c-97499e696216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:14.537708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77726309-0611-4d19-846c-97499e696216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:14.542900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 865/1754] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:14.570056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77726309-0611-4d19-846c-97499e696216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:14.571605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77726309-0611-4d19-846c-97499e696216 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:14.593011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 890/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:18:14.758950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:14.774058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4065d41-18c8-4d03-8dbb-e24041a3c3d0 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:14.779695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:14.780445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:14.780851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:14.781205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:14.785930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:14.944631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:14.947865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:14.961297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 866/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:15.402829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c882-7e1b-478b-8003-eeaaaaf26120 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:15.403579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c882-7e1b-478b-8003-eeaaaaf26120 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:15.404012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c882-7e1b-478b-8003-eeaaaaf26120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:15.444603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0127c882-7e1b-478b-8003-eeaaaaf26120 None None] MFA Rules not processed for user `acee9273e0714017bb29bbc578847b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:15.449811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0127c882-7e1b-478b-8003-eeaaaaf26120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:15.558434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:15.577709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7c2d3-7a88-445c-8da3-23d83440550c service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:15.591330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 891/1757] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:15.597991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:15.600417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:15.600809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:15.602312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] PATH_INFO: `/v3/users/aafab7de628f4249a5bf8cde4c1dbd77` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:15.605317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafab7de628f4249a5bf8cde4c1dbd77)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:15.610829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:15.754910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafab7de628f4249a5bf8cde4c1dbd77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:15.774093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafab7de628f4249a5bf8cde4c1dbd77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:15.808394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafab7de628f4249a5bf8cde4c1dbd77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:15.809493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafab7de628f4249a5bf8cde4c1dbd77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:15.845025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafab7de628f4249a5bf8cde4c1dbd77'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:15.867905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 867/1758] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:15 2022] DELETE /identity/v3/users/aafab7de628f4249a5bf8cde4c1dbd77 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:15.872393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6981ac-040c-4788-bb6b-63deb4c2d759 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:15.872961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6981ac-040c-4788-bb6b-63deb4c2d759 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:15.873390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6981ac-040c-4788-bb6b-63deb4c2d759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:15.916423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8e6981ac-040c-4788-bb6b-63deb4c2d759 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:15.917830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8e6981ac-040c-4788-bb6b-63deb4c2d759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:16.056627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 892/1759] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:16.107797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:16.110439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:16.202824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:16.240280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e650cf-b59d-4c62-a397-f0407ae52f9a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:16.248718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1b518-4a78-4247-8fae-5e1a662b1d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:16.250262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b518-4a78-4247-8fae-5e1a662b1d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:16.250699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b518-4a78-4247-8fae-5e1a662b1d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:16.251098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1b518-4a78-4247-8fae-5e1a662b1d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:16.275585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1b518-4a78-4247-8fae-5e1a662b1d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:16.277169 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1b518-4a78-4247-8fae-5e1a662b1d4f service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:16.296875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 868/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:16.681588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:16.682077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:16.682151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:16.723913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] MFA Rules not processed for user `2ab3cbf49f514ba0bc7cf2e387f4933f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:16.725581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:16.794161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:16.875599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 893/1761] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:17.453381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dcd7a-8767-4abc-b5c7-506a0bf5f983 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:17.454014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dcd7a-8767-4abc-b5c7-506a0bf5f983 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:17.454014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dcd7a-8767-4abc-b5c7-506a0bf5f983 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:17.456395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 869/1762] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:18:17.530476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:17.532091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:17.568601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a0701-1b46-4961-b347-36e74df52740 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:17.584375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:17.584669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:17.584961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:17.594861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:17.595932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:17.599578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:17.600203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] PATH_INFO: `/v3/projects/8e85e55d4954429ea25e5c00b6415434` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:17.603823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e85e55d4954429ea25e5c00b6415434)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:17.606053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:17.626392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:17.628240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:17.760087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e85e55d4954429ea25e5c00b6415434', 'request_id': 'req-81dde2e5-767f-452a-ae53-4d3a380306c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:17.775467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e85e55d4954429ea25e5c00b6415434', 'request_id': 'req-81dde2e5-767f-452a-ae53-4d3a380306c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:17.796380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e85e55d4954429ea25e5c00b6415434', 'request_id': 'req-81dde2e5-767f-452a-ae53-4d3a380306c2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:17.814413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] The token cache is being invalidate because project 8e85e55d4954429ea25e5c00b6415434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:17.815560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:17.816472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:17.825728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 894/1763] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:17 2022] DELETE /identity/v3/projects/8e85e55d4954429ea25e5c00b6415434 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:17.829864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:17.830025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 870/1764] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:18:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:17.832934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:17.983614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dde2e5-767f-452a-ae53-4d3a380306c2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:17.998217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:17.999522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:18.000872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:18.001308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] PATH_INFO: `/v3/users/dd26498843db402d8654dd6690c63ff6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:18.003618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd26498843db402d8654dd6690c63ff6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:18.006756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:18.104943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd26498843db402d8654dd6690c63ff6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:18.121705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd26498843db402d8654dd6690c63ff6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:18.122852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd26498843db402d8654dd6690c63ff6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:18.147156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:18.169192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd26498843db402d8654dd6690c63ff6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:18.170902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd26498843db402d8654dd6690c63ff6'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:18.231564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 895/1765] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:17 2022] DELETE /identity/v3/users/dd26498843db402d8654dd6690c63ff6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:19.699484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:19.701518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:19.728318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c9c04-80ee-4601-b13e-58366731cf52 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:19.848654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:19.849728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:19.850174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:19.850603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:19.853160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:19.868981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:19.872045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe7d3d-9142-4238-97c8-f0af8f0dcb95 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:19.892213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:19.893800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:19.894256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 871/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:20.026881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288b5d5-046d-4a37-95e0-13e5e3e63151 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:20.032058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:20.033220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.034180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.034472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] PATH_INFO: `/v3/projects/a21dde35668545e1bfdf1a377da45d49` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.035902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21dde35668545e1bfdf1a377da45d49)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:20.037835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:20.101884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21dde35668545e1bfdf1a377da45d49', 'request_id': 'req-750563c4-29ef-486c-a07e-c8f253bf0fd4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.120564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21dde35668545e1bfdf1a377da45d49', 'request_id': 'req-750563c4-29ef-486c-a07e-c8f253bf0fd4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.131093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21dde35668545e1bfdf1a377da45d49', 'request_id': 'req-750563c4-29ef-486c-a07e-c8f253bf0fd4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.146648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] The token cache is being invalidate because project a21dde35668545e1bfdf1a377da45d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:20.147573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.148306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.150443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 896/1767] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:19 2022] DELETE /identity/v3/projects/a21dde35668545e1bfdf1a377da45d49 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:20.155812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8287a96-2300-4d39-8fbd-e5fdd1c53a67 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.156375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8287a96-2300-4d39-8fbd-e5fdd1c53a67 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.156829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8287a96-2300-4d39-8fbd-e5fdd1c53a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.207161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b8287a96-2300-4d39-8fbd-e5fdd1c53a67 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:20.209353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b8287a96-2300-4d39-8fbd-e5fdd1c53a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:20.244425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:20.250068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:20.391987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:20.494653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 872/1768] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:20.503141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.503453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.503940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.534835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750563c4-29ef-486c-a07e-c8f253bf0fd4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:20.555387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:20.556742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.557263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.558260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:20.558695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] PATH_INFO: `/v3/projects/b9936cc4b1074b5b9b44521f149306d4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.559884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:20.562788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9936cc4b1074b5b9b44521f149306d4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:20.568577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:20.589071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 873/1769] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:20.591283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:20.593165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:20.614338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe7423-15a5-433e-b102-d4d6599e5465 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:20.631784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:20.635630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.635719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.635949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.637582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:20.637909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:20.644661 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:20.699157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 874/1770] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:18:20.705363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:20.723733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9936cc4b1074b5b9b44521f149306d4', 'request_id': 'req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.742965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9936cc4b1074b5b9b44521f149306d4', 'request_id': 'req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.748352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b9b96-d604-4270-bae9-a37dc70b8c68 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:20.762294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9936cc4b1074b5b9b44521f149306d4', 'request_id': 'req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.805197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] The token cache is being invalidate because project b9936cc4b1074b5b9b44521f149306d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:20.805677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.807297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:20.813235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 897/1771] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:20 2022] DELETE /identity/v3/projects/b9936cc4b1074b5b9b44521f149306d4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:20.818429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:20.825106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:20.946347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f2c5a-3ec3-4433-bf43-957e57b6a5f2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:20.951673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:20.952689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.952987 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.953274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] PATH_INFO: `/v3/users/6b8f3e08654e4c6692b9a5ac936eb6a4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.957451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8f3e08654e4c6692b9a5ac936eb6a4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:20.960477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:20.984959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f17633-b577-4688-a456-67b1c2cf8df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:20.985650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17633-b577-4688-a456-67b1c2cf8df9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:20.985936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17633-b577-4688-a456-67b1c2cf8df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:20.986216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f17633-b577-4688-a456-67b1c2cf8df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:20.986960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f17633-b577-4688-a456-67b1c2cf8df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:20.993429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f17633-b577-4688-a456-67b1c2cf8df9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:21.121423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 875/1772] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:20 2022] POST /identity/v3/projects => generated 389 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:21.122879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8f3e08654e4c6692b9a5ac936eb6a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:21.133857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b47a8-7c8b-45c3-8193-538e9537c692 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.134257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b47a8-7c8b-45c3-8193-538e9537c692 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.136517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b47a8-7c8b-45c3-8193-538e9537c692 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.144551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 876/1773] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:18:21 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:18:21.146314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8f3e08654e4c6692b9a5ac936eb6a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:21.147240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8f3e08654e4c6692b9a5ac936eb6a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:21.151509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b47a8-7c8b-45c3-8193-538e9537c692 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:21.165107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-228b47a8-7c8b-45c3-8193-538e9537c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:21.194016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8f3e08654e4c6692b9a5ac936eb6a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:21.198552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-df6e73a2-586d-4c0e-b403-3b93d665461d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8f3e08654e4c6692b9a5ac936eb6a4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:21.276053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 898/1774] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:20 2022] DELETE /identity/v3/users/6b8f3e08654e4c6692b9a5ac936eb6a4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:21.351267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.351580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.352263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.410258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:21.411793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:21.460384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:21.471755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b47a8-7c8b-45c3-8193-538e9537c692 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:21.604911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 899/1775] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:21.626406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:21.628158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.628596 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.629019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.629895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:21.632288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:21.644667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:21.666674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 877/1776] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:21 2022] POST /identity/v3/users => generated 295 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:21.671270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:21.689720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a84c6d-fc1f-458b-b8cc-3e3558204545 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:21.696801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:21.697128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.697397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.698488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.699682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:21.702218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:21.717768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 900/1777] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:21.719226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:21.735688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf7910-115f-4d60-9546-c1b3b841d942 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:21.742231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de1b1f-5723-4f33-a55b-853a46e2461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:21.743288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1b1f-5723-4f33-a55b-853a46e2461d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.743288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1b1f-5723-4f33-a55b-853a46e2461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.744034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de1b1f-5723-4f33-a55b-853a46e2461d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.744782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de1b1f-5723-4f33-a55b-853a46e2461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:21.746548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de1b1f-5723-4f33-a55b-853a46e2461d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:21.768678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 878/1778] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:21.779965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:21.798612 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf90ff8-4f9f-40d2-ba8f-54c4268cd481 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:21.804908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:21.805887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.806360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.806868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] PATH_INFO: `/v3/projects/f2e1ee4de4f94608b1f1aafd81f2e617/users/d0762e52f10741c3a5bdb8003efe32d5/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.826784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e1ee4de4f94608b1f1aafd81f2e617, user_id=d0762e52f10741c3a5bdb8003efe32d5, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:21.830049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:21.860779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 901/1779] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:21 2022] PUT /identity/v3/projects/f2e1ee4de4f94608b1f1aafd81f2e617/users/d0762e52f10741c3a5bdb8003efe32d5/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:21.864513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:21.864811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:21.865101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:21.921589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] MFA Rules not processed for user `d0762e52f10741c3a5bdb8003efe32d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:21.923824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:21.994630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:21.996784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:22.055479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 879/1780] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:22.063273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.158564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a366b-e0a8-4e6e-a12e-dcf575615024 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.165418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.166085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.166374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.166654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.180810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.182457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.189991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33daf8-5ef4-4028-9251-03d46942da78 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.194520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 902/1781] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:18:22.194686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.195370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.195482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.195654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.195937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.196700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:22.196817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.198706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.251889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f9c60-9885-468f-ab85-0583452f7c7d service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.265293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 880/1782] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:22 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:22.270893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.280204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.283350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.284235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.287942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] PATH_INFO: `/v3/projects/12d5595362044627869f04a312ebcb2d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.290479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d5595362044627869f04a312ebcb2d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.294581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.414275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93d90d-3e17-4c45-b080-94373116b10a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.422003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:22.422889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d5595362044627869f04a312ebcb2d', 'request_id': 'req-c7485858-6ca2-410f-9bdc-3d6031003d8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:22.427010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:22.445124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d5595362044627869f04a312ebcb2d', 'request_id': 'req-c7485858-6ca2-410f-9bdc-3d6031003d8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:22.461159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d5595362044627869f04a312ebcb2d', 'request_id': 'req-c7485858-6ca2-410f-9bdc-3d6031003d8f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:22.481630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] The token cache is being invalidate because project 12d5595362044627869f04a312ebcb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:22.481928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:22.483203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7485858-6ca2-410f-9bdc-3d6031003d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:22.485687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 903/1783] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:22 2022] DELETE /identity/v3/projects/12d5595362044627869f04a312ebcb2d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:22.491565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63d3a-273c-4a67-b6f3-09e8bb094d06 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.491866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63d3a-273c-4a67-b6f3-09e8bb094d06 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.492302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63d3a-273c-4a67-b6f3-09e8bb094d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.528427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d5e63d3a-273c-4a67-b6f3-09e8bb094d06 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:22.530125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d5e63d3a-273c-4a67-b6f3-09e8bb094d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:22.552632 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.553378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.553722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.553951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.555585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.559421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.603258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 881/1784] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:22 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:22.607215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.610457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:22.641105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23bc104-9d3b-4275-bc1d-7ff5a7f15718 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.664105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.664773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.665067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.665352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.669853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.671887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.691978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 904/1785] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:22.699833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 882/1786] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:22.702012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.702352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.704051 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.704635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.718593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdf7fe-1332-4fb8-9824-5b780570eb99 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.728446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.729358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.729710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.730184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] PATH_INFO: `/v3/projects/9e7306a9ee754f38acf69523343a576f/users/c9731c67162347369fda2aacf08964d8/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.762807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:22.764532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:22.773927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7306a9ee754f38acf69523343a576f, user_id=c9731c67162347369fda2aacf08964d8, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.778498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 905/1787] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:22.779832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.794376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.800349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 883/1788] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:22 2022] PUT /identity/v3/projects/9e7306a9ee754f38acf69523343a576f/users/c9731c67162347369fda2aacf08964d8/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:22.804673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.822454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147f7bd-8ce6-49b8-a209-0d039d0103dc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.904656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67330e5-dde9-4796-ba85-9409c97e7519 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.911786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.912881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.914252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.915296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.916144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.917973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:22.954033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 884/1789] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:22.959058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:22.978283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:22.979845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:22.980224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:22.980584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:22.981193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7333430-54a0-4f39-b5f7-068ff415fca3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:22.983591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:22.984805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:22.997238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.003971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd47ef-bfd8-4160-9944-c1bee7d31094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.008105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd47ef-bfd8-4160-9944-c1bee7d31094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.008745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd47ef-bfd8-4160-9944-c1bee7d31094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.010753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd47ef-bfd8-4160-9944-c1bee7d31094 admin admin] PATH_INFO: `/v3/projects/9e7306a9ee754f38acf69523343a576f/users/c9731c67162347369fda2aacf08964d8/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.014201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd47ef-bfd8-4160-9944-c1bee7d31094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7306a9ee754f38acf69523343a576f, user_id=c9731c67162347369fda2aacf08964d8, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.018372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd47ef-bfd8-4160-9944-c1bee7d31094 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.024426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 906/1790] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:23.025584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.039098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036522f-2507-437c-bb5d-1aee8827da8d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.044220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 885/1791] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:22 2022] PUT /identity/v3/projects/9e7306a9ee754f38acf69523343a576f/users/c9731c67162347369fda2aacf08964d8/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:23.045722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.046015 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.046347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.081292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] MFA Rules not processed for user `c9731c67162347369fda2aacf08964d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:23.082611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.148999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:23.195728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 886/1792] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:23.196852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.198159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.216523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.217792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.218084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.218367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.219101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.220043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f1e68-8f0f-4ce3-88ad-926eea582b8f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.221047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.225032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.236461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.237288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.239913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] PATH_INFO: `/v3/users/3d5b8efef52b4c32b27d107b452697e5` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.239913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5b8efef52b4c32b27d107b452697e5)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.241759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:23.243003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.261337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 907/1793] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:23 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:23.262573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.264482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.326808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5b8efef52b4c32b27d107b452697e5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.334794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5b8efef52b4c32b27d107b452697e5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.337903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113571de-a2cd-4b56-a4a6-5b80d077476a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.342106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee13ac-a816-4c15-aa75-3f49824ff87d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.342781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee13ac-a816-4c15-aa75-3f49824ff87d service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.343856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee13ac-a816-4c15-aa75-3f49824ff87d service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.344016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee13ac-a816-4c15-aa75-3f49824ff87d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.351218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5b8efef52b4c32b27d107b452697e5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.352193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5b8efef52b4c32b27d107b452697e5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.360594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5b8efef52b4c32b27d107b452697e5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.367713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 887/1794] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:23 2022] DELETE /identity/v3/users/3d5b8efef52b4c32b27d107b452697e5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:23.369225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.371329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.425017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee13ac-a816-4c15-aa75-3f49824ff87d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.426495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee13ac-a816-4c15-aa75-3f49824ff87d service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.436666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9bae6-7bc7-4251-9861-7044dfd57d98 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.437089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 908/1795] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:23.438453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.438756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.439069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.441549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.442224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.442600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.442883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.443714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.445573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.463256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:23.465085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.475189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 888/1796] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:23 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:23.476594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.477977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 909/1797] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:23.488711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d5c56-60e6-4932-89ee-66f94bfe00db admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.491112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.492954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.494926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.495750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.496108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.496451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.497246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.499376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.518548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 889/1798] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:23.519709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.530911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f12c26-5356-4d73-a594-cdb1f85f5fd8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.537089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.537942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.538209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.538662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.539483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.541449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.562862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 890/1799] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:23.564858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.576425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cffbb-401c-47f9-b5c4-dc2199772ccd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.581590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.582585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.582798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.583078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] PATH_INFO: `/v3/projects/dc9deff2a3ad4947b7f70a529b700583/users/b4bcde3de84d4c1b8226b0eb8f33c68f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.589292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:23.603389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9deff2a3ad4947b7f70a529b700583, user_id=b4bcde3de84d4c1b8226b0eb8f33c68f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.606873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.625342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c5d8-c178-43e3-9986-02f73dc2a6d3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.629256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 891/1800] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:23 2022] PUT /identity/v3/projects/dc9deff2a3ad4947b7f70a529b700583/users/b4bcde3de84d4c1b8226b0eb8f33c68f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:23.629931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.631815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.691588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b97e5-ae9d-44ee-b213-b5eeee8dd7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.692716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b97e5-ae9d-44ee-b213-b5eeee8dd7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.692716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b97e5-ae9d-44ee-b213-b5eeee8dd7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.692904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b97e5-ae9d-44ee-b213-b5eeee8dd7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.701879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:23.724198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aeefd-5c9a-40d2-8ff4-1fae43bde6e8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:23.730275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:23.732083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.733696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.734063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] PATH_INFO: `/v3/users/d0762e52f10741c3a5bdb8003efe32d5` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.735771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0762e52f10741c3a5bdb8003efe32d5)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.737615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.789280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b97e5-ae9d-44ee-b213-b5eeee8dd7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:23.790823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b97e5-ae9d-44ee-b213-b5eeee8dd7d8 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:23.803711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 910/1801] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:23.806587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.807486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.807486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.816862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0762e52f10741c3a5bdb8003efe32d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.829365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0762e52f10741c3a5bdb8003efe32d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.842907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] MFA Rules not processed for user `b4bcde3de84d4c1b8226b0eb8f33c68f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:23.845267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.852599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0762e52f10741c3a5bdb8003efe32d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.853442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0762e52f10741c3a5bdb8003efe32d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.870728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a4db508-6dc7-4f15-822a-fe67ac3660da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0762e52f10741c3a5bdb8003efe32d5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:23.882572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 892/1802] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:23 2022] DELETE /identity/v3/users/d0762e52f10741c3a5bdb8003efe32d5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:23.888188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:23.888769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:23.889116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:23.927781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:23.929385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:23.963546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 911/1803] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:23.977404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:23.979252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:24.027013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 893/1804] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:24.044304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:24.047023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:24.047996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42db56-1189-44f6-8a64-344897bccea2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:24.058734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:24.115287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:24.122462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:24.123178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:24.123644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:24.123936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:24.161105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de82a4-9106-4262-8fb9-af05d0a66ce1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:24.173695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:24.174404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:24.174692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:24.174979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:24.203242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:24.204623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:24.231300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 894/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:24.238731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:24.240249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:24.264036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 912/1806] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:25.039369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:25.041734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:25.097312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c89f11-47d2-43b9-9a43-3c0d131e4cf2 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:25.103481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:25.104571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:25.105025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:25.105617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] PATH_INFO: `/v3/projects/9fe8002ecc90407fbb4c4c9cd0c95cca` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:25.107184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe8002ecc90407fbb4c4c9cd0c95cca)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:25.112698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:25.201228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe8002ecc90407fbb4c4c9cd0c95cca', 'request_id': 'req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.222880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe8002ecc90407fbb4c4c9cd0c95cca', 'request_id': 'req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.232870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe8002ecc90407fbb4c4c9cd0c95cca', 'request_id': 'req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.249914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] The token cache is being invalidate because project 9fe8002ecc90407fbb4c4c9cd0c95cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:25.250208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.250947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.255848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 895/1807] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:25 2022] DELETE /identity/v3/projects/9fe8002ecc90407fbb4c4c9cd0c95cca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:25.256053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:25.257285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:25.257808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:25.258965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:25.282743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24325dd5-0020-4288-b783-3993b5fe9aa0 service glance] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:25.398835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9cb16-03fe-4d68-b0b3-b660b77fb9d1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:25.420000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:25.421483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:25.421788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:25.422081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] PATH_INFO: `/v3/users/d76a058b43a84e8a8a24da4935e11f38` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:25.424038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76a058b43a84e8a8a24da4935e11f38)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:25.428907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:25.458144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:25.459512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:25.459992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:25.460485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] PATH_INFO: `/v3/projects/f2e1ee4de4f94608b1f1aafd81f2e617` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:25.462012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e1ee4de4f94608b1f1aafd81f2e617)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:25.464345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:25.523316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:25.568555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e1ee4de4f94608b1f1aafd81f2e617', 'request_id': 'req-90d653f5-8242-459b-be48-5e3aa2c69e81'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.575611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76a058b43a84e8a8a24da4935e11f38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.579289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e1ee4de4f94608b1f1aafd81f2e617', 'request_id': 'req-90d653f5-8242-459b-be48-5e3aa2c69e81'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.601340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76a058b43a84e8a8a24da4935e11f38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.602416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e1ee4de4f94608b1f1aafd81f2e617', 'request_id': 'req-90d653f5-8242-459b-be48-5e3aa2c69e81'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.616208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] The token cache is being invalidate because project f2e1ee4de4f94608b1f1aafd81f2e617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:25.616643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.617369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.619079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 913/1808] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:25 2022] DELETE /identity/v3/projects/f2e1ee4de4f94608b1f1aafd81f2e617 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:25.625036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:25.625687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76a058b43a84e8a8a24da4935e11f38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.626414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76a058b43a84e8a8a24da4935e11f38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.626786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:25.636076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76a058b43a84e8a8a24da4935e11f38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.657140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 896/1809] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:25 2022] DELETE /identity/v3/users/d76a058b43a84e8a8a24da4935e11f38 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:25.676442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:25.732573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d653f5-8242-459b-be48-5e3aa2c69e81 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:25.868058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:25.870022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:25.870390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:25.872317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] PATH_INFO: `/v3/users/c9731c67162347369fda2aacf08964d8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:25.873349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9731c67162347369fda2aacf08964d8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:25.875629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:25.945654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9731c67162347369fda2aacf08964d8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.963017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9731c67162347369fda2aacf08964d8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:25.964199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9731c67162347369fda2aacf08964d8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.002375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9731c67162347369fda2aacf08964d8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.003634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4d3517ff-c656-4ac2-91fa-dfdbed75681d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9731c67162347369fda2aacf08964d8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.023154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 914/1810] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:25 2022] DELETE /identity/v3/users/c9731c67162347369fda2aacf08964d8 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:26.146497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:26.148218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:26.169457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66478555-e755-48aa-a449-996e4d755077 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:26.359018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:26.362738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:26.363747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:26.365897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] PATH_INFO: `/v3/projects/ebc4543d691b404799e90b9e6dffab65` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:26.366845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc4543d691b404799e90b9e6dffab65)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:26.376785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:26.527199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc4543d691b404799e90b9e6dffab65', 'request_id': 'req-1c8f2f89-d142-46bf-812c-c167079edc8b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.546472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc4543d691b404799e90b9e6dffab65', 'request_id': 'req-1c8f2f89-d142-46bf-812c-c167079edc8b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.564467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc4543d691b404799e90b9e6dffab65', 'request_id': 'req-1c8f2f89-d142-46bf-812c-c167079edc8b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.592338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] The token cache is being invalidate because project ebc4543d691b404799e90b9e6dffab65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:26.592669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.593315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1c8f2f89-d142-46bf-812c-c167079edc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:26.598670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 897/1811] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:26 2022] DELETE /identity/v3/projects/ebc4543d691b404799e90b9e6dffab65 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:26.600533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:26.601054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:26.601353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:26.632118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:26.633551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:26.747253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:26.758905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 915/1812] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:26.766438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:26.766994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:26.767645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:26.798412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:26.799924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:26.832649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 898/1813] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:26.835188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:26.849191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6878b3a-c5a6-4da4-87fd-c545789367ad None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:26.854294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:26.855236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:26.855627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:26.856010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:26.856852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:26.857268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:26.867335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:26.873637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 916/1814] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:18:26.877753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:26.888837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734a482-e2c7-4cfd-8b2a-bbb37d34f8d5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:26.909690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:26.911519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:26.911928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:26.918744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:26.920879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:26.923293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:26.955257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 899/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:26 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:26.960176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:26.973044 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12d68a-aa3a-4261-b095-281ff328257d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.066091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.067962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.068323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.068961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.069990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.072276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.109122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 917/1816] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:26 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:27.110463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.110595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.113230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:27.122934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c5b8f-2162-4c62-a09d-faed194a8f2a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.126833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6821c8-fc74-40d2-9017-ff320559cfbe admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.128592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.129299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.129588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.130099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.131215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.132487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.149207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.150826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.151329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.151449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 918/1817] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:27.152044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] PATH_INFO: `/v3/projects/9e7306a9ee754f38acf69523343a576f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.156024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.161256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7306a9ee754f38acf69523343a576f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.163688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.167419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255721-af7e-49d7-abc5-b192a20b8407 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.172667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.173415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.173765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.174191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.175765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:27.176128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.178056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.205049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 919/1818] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:27.206820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.219980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d5902-c1a6-4803-b19b-7372be0e4c1b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.228705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f111d6-de51-409f-9db9-c75fc75dca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.230475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f111d6-de51-409f-9db9-c75fc75dca31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.230948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f111d6-de51-409f-9db9-c75fc75dca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.231534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f111d6-de51-409f-9db9-c75fc75dca31 admin admin] PATH_INFO: `/v3/projects/2f68aa99314a478c862c9cda1fef369e/users/59c1f16946814c11aa38f6fd24abf7c9/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.253733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7306a9ee754f38acf69523343a576f', 'request_id': 'req-9506c331-e4e6-4ac6-b90b-67784675aed2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:27.255447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f111d6-de51-409f-9db9-c75fc75dca31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f68aa99314a478c862c9cda1fef369e, user_id=59c1f16946814c11aa38f6fd24abf7c9, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.259409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f111d6-de51-409f-9db9-c75fc75dca31 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.264086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7306a9ee754f38acf69523343a576f', 'request_id': 'req-9506c331-e4e6-4ac6-b90b-67784675aed2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:27.282378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7306a9ee754f38acf69523343a576f', 'request_id': 'req-9506c331-e4e6-4ac6-b90b-67784675aed2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:27.286324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 920/1819] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:27 2022] PUT /identity/v3/projects/2f68aa99314a478c862c9cda1fef369e/users/59c1f16946814c11aa38f6fd24abf7c9/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:27.296548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] The token cache is being invalidate because project 9e7306a9ee754f38acf69523343a576f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:27.296989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:27.297333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.297895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.298094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9506c331-e4e6-4ac6-b90b-67784675aed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:27.298476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.300310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 900/1820] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:27 2022] DELETE /identity/v3/projects/9e7306a9ee754f38acf69523343a576f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:27.307533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e326b9-27bb-4978-bfcb-ab1c7b9cd283 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.307963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e326b9-27bb-4978-bfcb-ab1c7b9cd283 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.308383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e326b9-27bb-4978-bfcb-ab1c7b9cd283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.334054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] MFA Rules not processed for user `59c1f16946814c11aa38f6fd24abf7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:27.335363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:27.342625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-61e326b9-27bb-4978-bfcb-ab1c7b9cd283 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:27.344522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-61e326b9-27bb-4978-bfcb-ab1c7b9cd283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:27.450039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 921/1821] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:27.451179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 901/1822] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:27.453337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.454494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.454792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.454976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:27.455235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.469094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416061c-d337-4abf-8ed6-52bea37e044a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.481646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.482338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.482633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.482913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.484432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.486363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.491759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:27.492937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:27.504639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 902/1823] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:27.508526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.514381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:27.519610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb997e-4ca9-4457-b2fa-e1b86a93ae14 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.525271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 922/1824] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:27.528943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.530077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.530077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.530286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.530915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:27.531261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.531546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.532891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.546414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 903/1825] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:18:27.551336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.567949 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cd6c2-94cb-4cff-9404-65089be49a31 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.632120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f48c0-c0c0-4d0a-8ac4-1c272d832f95 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.636743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.637674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.638405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.638652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.639543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.641725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.671763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.679128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.679417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.679698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.680428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.682406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.683329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 923/1826] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:27.684935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.700112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b545e-2102-4c78-a596-25dfb0a1c981 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.706605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.707454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.707750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.708094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.709000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.710722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.718880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:27.724241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 924/1827] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:27.728318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.735987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 904/1828] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:27.741442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.746839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840fb73-5e23-499d-b911-d866adba99f1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.848767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.850206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.850722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.851344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] PATH_INFO: `/v3/projects/87828db1b266486c8f78faa2187e7201/users/863d2b5cc61a4fd9a9dea258edaa1192/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.871923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87828db1b266486c8f78faa2187e7201, user_id=863d2b5cc61a4fd9a9dea258edaa1192, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.874675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.875225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fd12a-5699-4c5f-83be-3c24d7c06553 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:27.881867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:27.883120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:27.884114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:27.884373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:27.885175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:27.887280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:27.895849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 925/1829] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:27 2022] PUT /identity/v3/projects/87828db1b266486c8f78faa2187e7201/users/863d2b5cc61a4fd9a9dea258edaa1192/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:27.899588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.943309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 905/1830] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:27 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:27.944625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:27.958851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d607c-a02d-4ba6-b236-88851c8237a9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.014962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea92ce-afbf-472b-a45d-dbb72608d680 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.028617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.031273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.031745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.034552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.036424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.039106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.044806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:28.071190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 926/1831] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:28.073067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:28.089643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.090501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.091347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.095209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.097960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.100681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ddccc-880e-44a0-8646-e4a1c6f30599 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.103505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.120710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed38b57-d77d-481b-bdb8-c1b7d20a938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.121642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38b57-d77d-481b-bdb8-c1b7d20a938d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.127711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38b57-d77d-481b-bdb8-c1b7d20a938d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.128110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38b57-d77d-481b-bdb8-c1b7d20a938d admin admin] PATH_INFO: `/v3/projects/87828db1b266486c8f78faa2187e7201/users/863d2b5cc61a4fd9a9dea258edaa1192/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.133491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed38b57-d77d-481b-bdb8-c1b7d20a938d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87828db1b266486c8f78faa2187e7201, user_id=863d2b5cc61a4fd9a9dea258edaa1192, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.136334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 906/1832] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:28.138644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:28.141547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed38b57-d77d-481b-bdb8-c1b7d20a938d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.165669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda5c3e-77f8-4e13-8859-9a2993d9b762 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.171298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 927/1833] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:28 2022] PUT /identity/v3/projects/87828db1b266486c8f78faa2187e7201/users/863d2b5cc61a4fd9a9dea258edaa1192/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:28.185315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.185614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.185905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.235396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] MFA Rules not processed for user `863d2b5cc61a4fd9a9dea258edaa1192`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:28.236965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:28.250294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.250981 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.251303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.251589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.252403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.254775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.267335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 907/1834] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:28.275621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:28.302818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ebcb-7f8f-44b4-9489-505ca8600482 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.319267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b45af-c7ef-4f1b-b896-c6920cafba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.320311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b45af-c7ef-4f1b-b896-c6920cafba1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.320406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b45af-c7ef-4f1b-b896-c6920cafba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.320669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b45af-c7ef-4f1b-b896-c6920cafba1b admin admin] PATH_INFO: `/v3/projects/ecf1c1acfb4d4e3fac812ab3f9a83929/users/0bc12be6f84a4a07a6996357d0d9d654/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.386210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b45af-c7ef-4f1b-b896-c6920cafba1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf1c1acfb4d4e3fac812ab3f9a83929, user_id=0bc12be6f84a4a07a6996357d0d9d654, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.396252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b45af-c7ef-4f1b-b896-c6920cafba1b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.428641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:28.449170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 908/1835] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:28 2022] PUT /identity/v3/projects/ecf1c1acfb4d4e3fac812ab3f9a83929/users/0bc12be6f84a4a07a6996357d0d9d654/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:28.460910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.461155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.461327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.487325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 928/1836] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:28.497496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:28.500816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:28.523064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] MFA Rules not processed for user `0bc12be6f84a4a07a6996357d0d9d654`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:28.524755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:28.644312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce326dc-479b-41cb-9f83-230f68ad76c0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.656259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 909/1837] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:28.656259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:28.740247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.741317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.741704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.742650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.766871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f835-fae9-4272-9959-15d653872fd7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.773883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.775284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.775779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.776268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.777182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.779452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.822886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:28.826529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 910/1838] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:28 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:28.832320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:28.892543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.893841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:28.916744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 929/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:18:28.939486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e3d07-e446-46ce-98f2-10ad493447c9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:28.945628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:28.946669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:28.947715 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:28.948000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:28.948880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:28.955079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.003271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 911/1840] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:28 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:29.011426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:29.055557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd706b-8293-4383-921a-2eb7de0b6359 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:29.061616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:29.073600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:29.077513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:29.077513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.077513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.077513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.078008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:29.080083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.116678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 930/1841] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:29.120266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:29.159906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935147a1-760e-494b-b6aa-c292beabb2d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:29.175781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:29.176544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.177094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.178691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.179790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:29.192291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.221964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 931/1842] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:29.225813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:29.241662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d00d6a-3777-4b2f-8eee-e3512f73c01f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:29.254744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:29.258785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.258785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.258785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.284081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da4ec3-c8ae-4f59-9763-a2ccb60ead27 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:29.290577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5000e7-b7c9-4c30-a85e-2650a31b0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:29.292475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5000e7-b7c9-4c30-a85e-2650a31b0257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.292785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5000e7-b7c9-4c30-a85e-2650a31b0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.293082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5000e7-b7c9-4c30-a85e-2650a31b0257 admin admin] PATH_INFO: `/v3/projects/2604142edd894dcba029f312e285f7d5/users/13ef1908f1f04a9b80febbfaebecc7dd/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.324978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5000e7-b7c9-4c30-a85e-2650a31b0257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2604142edd894dcba029f312e285f7d5, user_id=13ef1908f1f04a9b80febbfaebecc7dd, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:29.328510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5000e7-b7c9-4c30-a85e-2650a31b0257 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.359148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 932/1843] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:29 2022] PUT /identity/v3/projects/2604142edd894dcba029f312e285f7d5/users/13ef1908f1f04a9b80febbfaebecc7dd/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:29.373559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.373951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.374314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.446790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] MFA Rules not processed for user `13ef1908f1f04a9b80febbfaebecc7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:29.450695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:29.455253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:29.460542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.494473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 912/1844] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:29.582699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 933/1845] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:29.593411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:29.612745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64f7e93-eccb-496a-a09c-f1235f70241f service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:29.695620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:29.697376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.697675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.697963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.698938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:29.701529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.746070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 913/1846] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:29 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:29.746561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:29.771731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94302955-1291-46ac-ac66-b31a5c26da08 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:29.923187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:29.923831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:29.924305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:29.924766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:29.925495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:29.928864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:29.980775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 934/1847] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:29 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:29.984560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:30.000903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea8e31-9678-4a72-abc4-859c9a60954b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:30.014541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:30.015532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.015670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.015935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.016682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:30.019001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:30.032497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 914/1848] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:30.040206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:30.068870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdecb8a-456f-4298-9449-ae4b956119b7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:30.078376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:30.079974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.081019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.082136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] PATH_INFO: `/v3/projects/a2013f7910324b2db215e695e62cd3c0/users/a47d0699dcbc44ca8fc72d6725876320/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.086472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:30.116690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2013f7910324b2db215e695e62cd3c0, user_id=a47d0699dcbc44ca8fc72d6725876320, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:30.119926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:30.146029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 935/1849] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:30 2022] PUT /identity/v3/projects/a2013f7910324b2db215e695e62cd3c0/users/a47d0699dcbc44ca8fc72d6725876320/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:30.149691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:30.174850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b65755-0687-4b70-9678-07214efab4bb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:30.228585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:30.274320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1240614-22f7-4205-bbd3-606662ea86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:30.275259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240614-22f7-4205-bbd3-606662ea86a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.275522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240614-22f7-4205-bbd3-606662ea86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.275811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1240614-22f7-4205-bbd3-606662ea86a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.276594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1240614-22f7-4205-bbd3-606662ea86a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:30.279075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1240614-22f7-4205-bbd3-606662ea86a5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:30.291373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 915/1850] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:30.295710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:30.312131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1116c-e662-492e-ad2d-e16d5c12bc69 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:30.317632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:30.318524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.318809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.319113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] PATH_INFO: `/v3/projects/a2013f7910324b2db215e695e62cd3c0/users/a47d0699dcbc44ca8fc72d6725876320/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.321187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2013f7910324b2db215e695e62cd3c0, user_id=a47d0699dcbc44ca8fc72d6725876320, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:30.323876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:30.344579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 936/1851] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:30 2022] PUT /identity/v3/projects/a2013f7910324b2db215e695e62cd3c0/users/a47d0699dcbc44ca8fc72d6725876320/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:30.346098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.346481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.346771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.381539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] MFA Rules not processed for user `a47d0699dcbc44ca8fc72d6725876320`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:30.383858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:30.466979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 916/1852] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:30.478960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:30.599273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e57820-8d88-4e8d-bd49-27b9f4297d3e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:30.605053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:30.605914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.606206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.607630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.623086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:30.626631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:30.647203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 937/1853] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:30.716404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:30.718028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:30.731732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df701108-bf5e-484a-9a64-852e9a73197c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:30.735908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5fb4e-dcea-4a4f-8c2e-c9f103321080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:30.737158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5fb4e-dcea-4a4f-8c2e-c9f103321080 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:30.737507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5fb4e-dcea-4a4f-8c2e-c9f103321080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:30.737850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5fb4e-dcea-4a4f-8c2e-c9f103321080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:30.807221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5fb4e-dcea-4a4f-8c2e-c9f103321080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:30.808689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5fb4e-dcea-4a4f-8c2e-c9f103321080 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:30.819260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 917/1854] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:34.037948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:34.156094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba24bd8-5258-4b20-8785-07d748b28013 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:34.171199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:34.171199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:34.171199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:34.171199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] PATH_INFO: `/v3/users/0bc12be6f84a4a07a6996357d0d9d654` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:34.172442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc12be6f84a4a07a6996357d0d9d654)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:34.174949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:34.256391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc12be6f84a4a07a6996357d0d9d654'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:34.275075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc12be6f84a4a07a6996357d0d9d654'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:34.276605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc12be6f84a4a07a6996357d0d9d654'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:34.291366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc12be6f84a4a07a6996357d0d9d654'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:34.292696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc12be6f84a4a07a6996357d0d9d654'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:34.295433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:34.314259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 938/1855] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:34 2022] DELETE /identity/v3/users/0bc12be6f84a4a07a6996357d0d9d654 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:34.315734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:34.316214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:34.316507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:34.337123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:34.338216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:34.494906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:34.556999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 918/1856] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:34.573715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:34.575517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:34.687794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138a8e4-fe1a-4e85-9af7-2dd7dc7f7a13 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:34.692846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:34.693517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:34.693806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:34.694088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:34.705205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:34.708618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:34.721776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 939/1857] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:35.090561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:35.092024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:35.104579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad05bc-e7d7-4e45-99bd-e009603fc64b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:35.119741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:35.121214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:35.121504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:35.121782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] PATH_INFO: `/v3/projects/ecf1c1acfb4d4e3fac812ab3f9a83929` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:35.123001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf1c1acfb4d4e3fac812ab3f9a83929)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:35.125010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:35.184061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf1c1acfb4d4e3fac812ab3f9a83929', 'request_id': 'req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.193948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf1c1acfb4d4e3fac812ab3f9a83929', 'request_id': 'req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.207284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf1c1acfb4d4e3fac812ab3f9a83929', 'request_id': 'req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.218267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] The token cache is being invalidate because project ecf1c1acfb4d4e3fac812ab3f9a83929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:35.218553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.219233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.220822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 919/1858] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:35 2022] DELETE /identity/v3/projects/ecf1c1acfb4d4e3fac812ab3f9a83929 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:35.224689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:35.234207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1817f5-f157-4d56-9344-301b6cd5fb81 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:35.307985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:35.309559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:35.309559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:35.309957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] PATH_INFO: `/v3/users/13ef1908f1f04a9b80febbfaebecc7dd` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:35.311318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ef1908f1f04a9b80febbfaebecc7dd)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:35.313332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:35.379875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ef1908f1f04a9b80febbfaebecc7dd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.393188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ef1908f1f04a9b80febbfaebecc7dd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.394241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ef1908f1f04a9b80febbfaebecc7dd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.410742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ef1908f1f04a9b80febbfaebecc7dd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.411659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ef1908f1f04a9b80febbfaebecc7dd'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:35.428155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 940/1859] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:35 2022] DELETE /identity/v3/users/13ef1908f1f04a9b80febbfaebecc7dd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:35.918960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:35.920434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:35.937240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98615c-a76d-4a71-b02d-8c3c6ac2f551 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:36.030323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:36.031261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:36.031669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:36.031966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] PATH_INFO: `/v3/projects/2604142edd894dcba029f312e285f7d5` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:36.033961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2604142edd894dcba029f312e285f7d5)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:36.037984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:36.131533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2604142edd894dcba029f312e285f7d5', 'request_id': 'req-0347f6b4-cd78-4730-b1dc-59eceb2617c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.149156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2604142edd894dcba029f312e285f7d5', 'request_id': 'req-0347f6b4-cd78-4730-b1dc-59eceb2617c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.158668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2604142edd894dcba029f312e285f7d5', 'request_id': 'req-0347f6b4-cd78-4730-b1dc-59eceb2617c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.170579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] The token cache is being invalidate because project 2604142edd894dcba029f312e285f7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:36.170866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.171595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.173142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 920/1860] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:35 2022] DELETE /identity/v3/projects/2604142edd894dcba029f312e285f7d5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:36.177218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:36.178596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:36.194252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34251-f9d2-42c6-8ac1-aa0c7767a387 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:36.203398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:36.263080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:36.263963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:36.264250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:36.264533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] PATH_INFO: `/v3/users/a47d0699dcbc44ca8fc72d6725876320` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:36.265725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47d0699dcbc44ca8fc72d6725876320)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:36.268242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:36.317468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47d0699dcbc44ca8fc72d6725876320'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.325495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47d0699dcbc44ca8fc72d6725876320'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.326124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47d0699dcbc44ca8fc72d6725876320'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.338895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47d0699dcbc44ca8fc72d6725876320'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.339503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8fccfd63-80ad-43d8-8b33-5d0618d9526b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47d0699dcbc44ca8fc72d6725876320'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.351741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 941/1861] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:36 2022] DELETE /identity/v3/users/a47d0699dcbc44ca8fc72d6725876320 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:36.703599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:36.705308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:36.719020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:36.736989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347f6b4-cd78-4730-b1dc-59eceb2617c4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:36.831907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:36.832830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:36.833119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:36.833401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] PATH_INFO: `/v3/projects/a2013f7910324b2db215e695e62cd3c0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:36.834612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2013f7910324b2db215e695e62cd3c0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:36.836747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:36.889196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2013f7910324b2db215e695e62cd3c0', 'request_id': 'req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.897114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2013f7910324b2db215e695e62cd3c0', 'request_id': 'req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.904385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2013f7910324b2db215e695e62cd3c0', 'request_id': 'req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.919814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] The token cache is being invalidate because project a2013f7910324b2db215e695e62cd3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:36.920385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.920780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-acbdc6bc-3589-4fc4-8e47-5ec80dca5ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:36.922438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 921/1862] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:36 2022] DELETE /identity/v3/projects/a2013f7910324b2db215e695e62cd3c0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:36.928805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:36.929099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:36.929380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:36.948263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:36.949541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.017824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 942/1863] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:37.026134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.026502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.026869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.047224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:37.048644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.062148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 922/1864] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:37.066036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.075818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65ad8b-8761-4dac-bc89-f0f410dfe12c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.080317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.080971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.081257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.081533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.082276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:37.082585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.084207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.099790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 943/1865] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:37.100805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.109955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d3506-e2cd-4099-b6aa-2cf32f346ac8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.115311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.115961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.116242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.116515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.117212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.119188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.157026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 923/1866] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:37.158172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.175419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875eb24-bc88-402c-b114-0d646ec0c7c3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.232698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:37.299833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.303379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.303860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.305318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.311836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.313221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.354970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 944/1867] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:37.356622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.372210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469b4d6-d4b9-4aa2-a1dc-4aa8471c5419 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.377041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.377714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.378002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.378285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.379010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.380912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.388531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.394843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.405532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 924/1868] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:37.409517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d600232-a005-4805-b0b6-f7572a5259e1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.409910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.415337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.416322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.416686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.417034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] PATH_INFO: `/v3/users/59c1f16946814c11aa38f6fd24abf7c9` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.418377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c1f16946814c11aa38f6fd24abf7c9)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.420396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.420687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a416-a1b6-42f8-9385-1534773375a0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.426045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.427226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.427226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.427435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.428170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.429753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.442010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 925/1869] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:37.446831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.457790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f025d2e-e5be-4641-a0f7-998207e7502c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.462829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1462f-1e96-45d4-bf4f-75b06646c902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.463814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1462f-1e96-45d4-bf4f-75b06646c902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.464165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1462f-1e96-45d4-bf4f-75b06646c902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.464513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1462f-1e96-45d4-bf4f-75b06646c902 admin admin] PATH_INFO: `/v3/projects/6892278e7b824f0f9f428d335930e96c/users/3e2d242fa3054838b201ec67ca8e7286/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.475169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c1f16946814c11aa38f6fd24abf7c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:37.483355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1462f-1e96-45d4-bf4f-75b06646c902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6892278e7b824f0f9f428d335930e96c, user_id=3e2d242fa3054838b201ec67ca8e7286, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.483528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c1f16946814c11aa38f6fd24abf7c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:37.484278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c1f16946814c11aa38f6fd24abf7c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:37.486381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1462f-1e96-45d4-bf4f-75b06646c902 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.502854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c1f16946814c11aa38f6fd24abf7c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:37.503718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0b5555e7-2bb2-49b9-954b-241b4161b4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c1f16946814c11aa38f6fd24abf7c9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:37.511313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 926/1870] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:37 2022] PUT /identity/v3/projects/6892278e7b824f0f9f428d335930e96c/users/3e2d242fa3054838b201ec67ca8e7286/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:37.518363 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 945/1871] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:37 2022] DELETE /identity/v3/users/59c1f16946814c11aa38f6fd24abf7c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:37.522923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.523272 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.523559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.524705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459274a6-f363-4652-9cd4-752c36899016 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.525151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459274a6-f363-4652-9cd4-752c36899016 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.525582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459274a6-f363-4652-9cd4-752c36899016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.540894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:37.542109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.554062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-459274a6-f363-4652-9cd4-752c36899016 None None] MFA Rules not processed for user `3e2d242fa3054838b201ec67ca8e7286`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:37.555296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-459274a6-f363-4652-9cd4-752c36899016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.555756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:37.610201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 927/1872] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:37.624553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.626356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.630016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 946/1873] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:37.635390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459274a6-f363-4652-9cd4-752c36899016 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.636770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-459274a6-f363-4652-9cd4-752c36899016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:37.651071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459274a6-f363-4652-9cd4-752c36899016 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.655794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.656490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.656777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.657057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.657756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.659783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.668732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:37.688485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 947/1874] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:37.693079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.697055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e74d2-2ffe-40f8-949d-e5ff50513a7d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.748191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.748869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.749157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.749433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.755691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c839a-ef53-4942-86ef-7819203d42af admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.759269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.760714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.761165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.761864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.762207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.762495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.763233 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.765209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.770673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 928/1875] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:37.789837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 948/1876] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:37 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:37.792531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.803412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b9c6-7934-4c9d-9990-44ef8bc21ddb service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.808347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.809026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.809671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.810612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.810727 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.812351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.827579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 929/1877] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:37.832244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.848704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb8d2-d542-431c-ae84-2f4113672c6f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:37.855170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:37.856001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:37.856294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:37.856618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] PATH_INFO: `/v3/projects/9d16d5219fae49ad9b3157e403b43e86/users/5cccb107e129408483cf07125e7f6e90/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:37.880945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d16d5219fae49ad9b3157e403b43e86, user_id=5cccb107e129408483cf07125e7f6e90, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:37.884139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:37.905528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 949/1878] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:37 2022] PUT /identity/v3/projects/9d16d5219fae49ad9b3157e403b43e86/users/5cccb107e129408483cf07125e7f6e90/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:37.909599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:37.922961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422c0b5-ea18-4df0-b9ac-1233152658de admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:38.021080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b79ec-bbe2-4e33-9bcf-ba9c90244241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:38.021838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b79ec-bbe2-4e33-9bcf-ba9c90244241 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:38.022133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b79ec-bbe2-4e33-9bcf-ba9c90244241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:38.022454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b79ec-bbe2-4e33-9bcf-ba9c90244241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:38.023305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b79ec-bbe2-4e33-9bcf-ba9c90244241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:38.025683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b79ec-bbe2-4e33-9bcf-ba9c90244241 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:38.040181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 930/1879] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:38.043893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:38.058601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65323a4d-9a67-4309-8c9d-d7afa341f407 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:38.066747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:38.079254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:38.080124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:38.080603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] PATH_INFO: `/v3/projects/9d16d5219fae49ad9b3157e403b43e86/users/5cccb107e129408483cf07125e7f6e90/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:38.084048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d16d5219fae49ad9b3157e403b43e86, user_id=5cccb107e129408483cf07125e7f6e90, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:38.088654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:38.105846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 950/1880] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:38 2022] PUT /identity/v3/projects/9d16d5219fae49ad9b3157e403b43e86/users/5cccb107e129408483cf07125e7f6e90/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:38.116676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:38.117221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:38.117609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:38.126476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:38.154320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] MFA Rules not processed for user `5cccb107e129408483cf07125e7f6e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:38.155586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:38.230843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 931/1881] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:38.244281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:38.246028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:38.362320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11629a48-7a68-4903-8c38-95ef19229efb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:38.369497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:38.370428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:38.370905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:38.371916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:38.476817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:38.479883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:38.481478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:38.501264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 951/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:38.677308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:38.682322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:38.826944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a316c1-498b-4658-9a7d-4e12b6004110 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:38.833409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:38.834295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:38.834585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:38.834870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] PATH_INFO: `/v3/projects/2f68aa99314a478c862c9cda1fef369e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:38.836137 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f68aa99314a478c862c9cda1fef369e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:38.838773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:38.929892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f68aa99314a478c862c9cda1fef369e', 'request_id': 'req-0835c920-206f-41ca-8a1e-5b90783c1d32'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:38.947984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f68aa99314a478c862c9cda1fef369e', 'request_id': 'req-0835c920-206f-41ca-8a1e-5b90783c1d32'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:38.961157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f68aa99314a478c862c9cda1fef369e', 'request_id': 'req-0835c920-206f-41ca-8a1e-5b90783c1d32'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:38.985617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] The token cache is being invalidate because project 2f68aa99314a478c862c9cda1fef369e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:38.985833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:38.989321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:38.992894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 932/1883] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:38 2022] DELETE /identity/v3/projects/2f68aa99314a478c862c9cda1fef369e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:38.997567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:39.015311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657b35c-7243-4cd2-b520-e3cff3f6a479 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:39.090091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:39.092116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:39.092554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:39.092933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] PATH_INFO: `/v3/users/863d2b5cc61a4fd9a9dea258edaa1192` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:39.095981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=863d2b5cc61a4fd9a9dea258edaa1192)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:39.099398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:39.224696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863d2b5cc61a4fd9a9dea258edaa1192'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.234364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863d2b5cc61a4fd9a9dea258edaa1192'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.235481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863d2b5cc61a4fd9a9dea258edaa1192'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.264114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863d2b5cc61a4fd9a9dea258edaa1192'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.264858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-10d015d9-8ab7-4c0b-bfc7-36d884b7f152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863d2b5cc61a4fd9a9dea258edaa1192'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.277977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 952/1884] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:38 2022] DELETE /identity/v3/users/863d2b5cc61a4fd9a9dea258edaa1192 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:39.562543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:39.564018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:39.578215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835c920-206f-41ca-8a1e-5b90783c1d32 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:39.595967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:39.638505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:39.639406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:39.639716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:39.639987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] PATH_INFO: `/v3/projects/87828db1b266486c8f78faa2187e7201` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:39.641163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87828db1b266486c8f78faa2187e7201)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:39.643119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:39.689084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87828db1b266486c8f78faa2187e7201', 'request_id': 'req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.696340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87828db1b266486c8f78faa2187e7201', 'request_id': 'req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.702755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87828db1b266486c8f78faa2187e7201', 'request_id': 'req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.714248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] The token cache is being invalidate because project 87828db1b266486c8f78faa2187e7201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:39.714537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.715213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bf94de1-bbb9-43cf-9c9a-450cf8ac5a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:39.716745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 933/1885] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:39 2022] DELETE /identity/v3/projects/87828db1b266486c8f78faa2187e7201 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:39.721572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:39.722048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:39.722306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:39.740824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:39.742038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:39.803711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 953/1886] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:39.812028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:39.812324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:39.812609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:39.830601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:39.831832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:39.839651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 934/1887] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:39.843851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:39.855228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19b4a8-27f2-41d8-af06-a4b296273c2e None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:39.859777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:39.860434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:39.860722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:39.861007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:39.862358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:39.862670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:39.864306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:39.875980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 954/1888] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:39.880696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:39.889784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91d657-c711-44a3-b1e4-93d8b510e38e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:39.895777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:39.896429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:39.896717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:39.896998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:39.897721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:39.899703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:39.925461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 935/1889] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:39 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:39.929517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:39.934904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:39.942161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae17ada-19f5-4120-bac5-65f6a967dfd6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.012448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.013249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.013737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.013963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.014745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.018922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.047079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 955/1890] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:39 2022] POST /identity/v3/users => generated 278 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:40.049532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.060353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d2aaf-22d3-459f-ab80-7ce68d3d1335 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.066011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.066689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.066982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.067298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.068034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.069642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.080883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 936/1891] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:40.084763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.095887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0cdf1-50d5-4f36-925b-54a8065f71d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.100572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e4f4b-0229-4df5-a8bd-41d0dbdd7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.101249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4f4b-0229-4df5-a8bd-41d0dbdd7b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.101539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4f4b-0229-4df5-a8bd-41d0dbdd7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.101823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4f4b-0229-4df5-a8bd-41d0dbdd7b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.102557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4f4b-0229-4df5-a8bd-41d0dbdd7b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.104190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4f4b-0229-4df5-a8bd-41d0dbdd7b86 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.114893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 956/1892] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:40.119124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.129526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef745e4-32aa-42c1-bbdd-2a2defbce06d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.134246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.136736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.136736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.136736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] PATH_INFO: `/v3/projects/b00cf2b4bad54a28abb6efdce95a8b04/users/0ab148966bf94ed1ade23d6cb2e88789/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.152475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00cf2b4bad54a28abb6efdce95a8b04, user_id=0ab148966bf94ed1ade23d6cb2e88789, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.155178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.169394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 937/1893] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:40 2022] PUT /identity/v3/projects/b00cf2b4bad54a28abb6efdce95a8b04/users/0ab148966bf94ed1ade23d6cb2e88789/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:40.180321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.180613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.180893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.208854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] MFA Rules not processed for user `0ab148966bf94ed1ade23d6cb2e88789`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:40.209980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:40.284761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 957/1894] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:40.289100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.378558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:40.396781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b1e9d-6190-4346-97a8-1520c2b0140a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.402395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.403483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.403998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.404800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.405695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.408218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.449497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 938/1895] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:40 2022] POST /identity/v3/projects => generated 357 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:40.453927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.465348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcc0c5-7216-4f8e-8b57-de3a040a2a78 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.546117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.546883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.547292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.548049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.548462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.551021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.571588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:40.581933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 958/1896] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:40 2022] POST /identity/v3/users => generated 285 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:40.583287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.594261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914ca88-afbb-49d3-b9c6-bcf9fb3c13df admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.600358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.601037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.601333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.601862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.602613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.604789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.619138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 939/1897] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:40.623560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.641083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b96635-9edc-438e-93d7-8591c1bf7770 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.648002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.649015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.649408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.649959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] PATH_INFO: `/v3/projects/a0a68daef5b344fcaa164fb6859cd378/users/a365f9ee9f6447529d6d0407c858d7df/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.671091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a68daef5b344fcaa164fb6859cd378, user_id=a365f9ee9f6447529d6d0407c858d7df, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.675711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.693247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 959/1898] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:40 2022] PUT /identity/v3/projects/a0a68daef5b344fcaa164fb6859cd378/users/a365f9ee9f6447529d6d0407c858d7df/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:40.696950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.710356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df8d3f-9339-4939-a9d1-cff59648a23d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.786626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e33cac-3d8a-48c4-8366-57b22798f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.787391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e33cac-3d8a-48c4-8366-57b22798f95c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.787685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e33cac-3d8a-48c4-8366-57b22798f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.787972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e33cac-3d8a-48c4-8366-57b22798f95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.788703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e33cac-3d8a-48c4-8366-57b22798f95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.790328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e33cac-3d8a-48c4-8366-57b22798f95c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.802212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 940/1899] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:40.806624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.817304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182fde1-37dc-49ac-ac77-8db577ee0061 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:40.821866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:40.822742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.823029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.823348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] PATH_INFO: `/v3/projects/a0a68daef5b344fcaa164fb6859cd378/users/a365f9ee9f6447529d6d0407c858d7df/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.825298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a68daef5b344fcaa164fb6859cd378, user_id=a365f9ee9f6447529d6d0407c858d7df, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:40.827994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:40.838026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 960/1900] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:40 2022] PUT /identity/v3/projects/a0a68daef5b344fcaa164fb6859cd378/users/a365f9ee9f6447529d6d0407c858d7df/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:40.849741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:40.850107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:40.850392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:40.876069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] MFA Rules not processed for user `a365f9ee9f6447529d6d0407c858d7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:40.877259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:40.943926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 941/1901] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:40.955927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:40.957630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:41.014854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27102baf-2726-42f4-bcfa-2270b347a995 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:41.019081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:41.019730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:41.020010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:41.020288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:41.029325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:41.030742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:41.041335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 961/1902] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:41.126911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:41.128351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:41.140384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d53df-0bf7-40a4-a719-a307825b3bd5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:41.144641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:41.145328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:41.145721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:41.146006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:41.193272 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:41.213076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:41.214637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:41.227562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 942/1903] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:41 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:43.151422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:43.160918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d81ee8-1a50-4c0c-9216-8120d106dc83 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:43.164789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:43.165203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:43.165495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:43.165778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:43.168646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:43.248115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:43.249580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4c67e-e840-4241-9d60-227684313ba9 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:43.266366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 962/1904] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:43.564434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:43.567580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:43.700567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a3566-ba83-4911-a2c1-0dc39cbe4d4d service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:43.708283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:43.709668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:43.710257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:43.711021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] PATH_INFO: `/v3/users/b4bcde3de84d4c1b8226b0eb8f33c68f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:43.713303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4bcde3de84d4c1b8226b0eb8f33c68f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:43.715785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:43.805431 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4bcde3de84d4c1b8226b0eb8f33c68f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:43.824493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4bcde3de84d4c1b8226b0eb8f33c68f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:43.851229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4bcde3de84d4c1b8226b0eb8f33c68f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:43.853049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4bcde3de84d4c1b8226b0eb8f33c68f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:43.865343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4bcde3de84d4c1b8226b0eb8f33c68f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:43.876923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 943/1905] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:43 2022] DELETE /identity/v3/users/b4bcde3de84d4c1b8226b0eb8f33c68f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:43.881861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:43.882153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:43.882483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:43.902566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:43.904157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:43.982602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:44.006910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 963/1906] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:44.039323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:44.041224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:44.154425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ee429-8e7a-4c28-8856-5ec30d81cd59 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:44.158559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feadd2d-8690-48c2-b486-58e1fde2110e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:44.160104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feadd2d-8690-48c2-b486-58e1fde2110e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:44.160483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feadd2d-8690-48c2-b486-58e1fde2110e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:44.160845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feadd2d-8690-48c2-b486-58e1fde2110e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:44.172412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feadd2d-8690-48c2-b486-58e1fde2110e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:44.176176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feadd2d-8690-48c2-b486-58e1fde2110e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:44.188746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 944/1907] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:44.944139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:44.949320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:44.968145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdd5d3-8ddb-444c-a2f9-00824887e623 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:44.976873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:44.977995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:44.978387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:44.978782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] PATH_INFO: `/v3/projects/dc9deff2a3ad4947b7f70a529b700583` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:44.980254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9deff2a3ad4947b7f70a529b700583)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:44.982771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.068577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9deff2a3ad4947b7f70a529b700583', 'request_id': 'req-9e9475ae-e559-42b5-99e7-cb07320dd155'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:45.078557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9deff2a3ad4947b7f70a529b700583', 'request_id': 'req-9e9475ae-e559-42b5-99e7-cb07320dd155'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:45.086358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9deff2a3ad4947b7f70a529b700583', 'request_id': 'req-9e9475ae-e559-42b5-99e7-cb07320dd155'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:45.102890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] The token cache is being invalidate because project dc9deff2a3ad4947b7f70a529b700583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:45.103299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:45.104026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9e9475ae-e559-42b5-99e7-cb07320dd155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:45.105929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 964/1908] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:44 2022] DELETE /identity/v3/projects/dc9deff2a3ad4947b7f70a529b700583 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:45.110790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.112520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.113022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.121101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:45.137921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:45.139114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:45.287609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 945/1909] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:45.297738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.298048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.298506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.322566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:45.324199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:45.338520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 965/1910] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:45.343333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:45.360037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376fbb1-d0f9-4746-a9d9-e29966f89ccd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:45.375430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:45.376127 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.376414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.376697 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.382005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:45.382386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:45.386667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.412086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 946/1911] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:45.414114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:45.426799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcb10-7a7f-4225-bbf7-7c82b2e175d6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:45.434544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:45.435544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.436030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.436519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.437496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:45.441060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.507203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 966/1912] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:45 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:45.507909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:45.522513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331b19f-4837-4915-b160-6834abdc5f56 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:45.682603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:45.683353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.683656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.684453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.685177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:45.687570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.721280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 947/1913] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:45 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:45.723801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:45.739304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349ec7d-2479-4a1f-b29e-8e693ae5fc13 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:45.768504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:45.769485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.769951 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.770412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.771641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:45.773627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.787992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 967/1914] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:45.792347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:45.811142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef5e41-d0ca-4dde-b7fb-08630208c5ad admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:45.834529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc744733-51e5-48b7-8dc5-6ac32b8eae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:45.834787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc744733-51e5-48b7-8dc5-6ac32b8eae5c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.835018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc744733-51e5-48b7-8dc5-6ac32b8eae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.837082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc744733-51e5-48b7-8dc5-6ac32b8eae5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.837733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc744733-51e5-48b7-8dc5-6ac32b8eae5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:45.843658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc744733-51e5-48b7-8dc5-6ac32b8eae5c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.870657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 948/1915] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:45.881158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:45.895434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361a75a-bfe1-4f75-8521-78fbfbbf1076 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:45.899941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:45.900847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.901138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.901427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] PATH_INFO: `/v3/projects/3ec70aa163d1447d99f7ac512c7ea528/users/6658c81d06bd494ca6f0afe4b6b03995/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.920422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec70aa163d1447d99f7ac512c7ea528, user_id=6658c81d06bd494ca6f0afe4b6b03995, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:45.923556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:45.942120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 968/1916] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:45 2022] PUT /identity/v3/projects/3ec70aa163d1447d99f7ac512c7ea528/users/6658c81d06bd494ca6f0afe4b6b03995/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:45.952859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:45.953154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:45.953436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:45.992072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] MFA Rules not processed for user `6658c81d06bd494ca6f0afe4b6b03995`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:45.993285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:46.086294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:46.106305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 949/1917] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:46.119377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:46.121165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:46.213046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0af61-bcb6-47c3-8119-24eb0ca240df admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:46.217167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f8a53-2bda-4f75-84e1-9098b98cb671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:46.218154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8a53-2bda-4f75-84e1-9098b98cb671 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:46.218787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8a53-2bda-4f75-84e1-9098b98cb671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:46.219607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f8a53-2bda-4f75-84e1-9098b98cb671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:46.231655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8a53-2bda-4f75-84e1-9098b98cb671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:46.233932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f8a53-2bda-4f75-84e1-9098b98cb671 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:46.246369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 969/1918] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:48.572400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:48.574894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:48.664905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f84bfd-a61a-4ddd-a851-c1198b8a040c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:48.669717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:48.670589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:48.670871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:48.671180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] PATH_INFO: `/v3/users/3e2d242fa3054838b201ec67ca8e7286` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:48.672365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2d242fa3054838b201ec67ca8e7286)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:48.674316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:48.726870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2d242fa3054838b201ec67ca8e7286'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:48.738346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2d242fa3054838b201ec67ca8e7286'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:48.755352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2d242fa3054838b201ec67ca8e7286'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:48.756099 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2d242fa3054838b201ec67ca8e7286'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:48.764764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2d242fa3054838b201ec67ca8e7286'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:48.771684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 950/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:48 2022] DELETE /identity/v3/users/3e2d242fa3054838b201ec67ca8e7286 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:48.776171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:48.776644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:48.776728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:48.793708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:48.794852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:48.811625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:48.857986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 970/1920] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:48.867523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:48.868903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:48.928061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdd12d-150c-4cc7-ab19-60aa2373b0a1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:48.931776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:48.932427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:48.932725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:48.933006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:48.943740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:48.945185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:48.956909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 951/1921] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:49.244997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:49.246949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:49.265323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb862c-7e5e-4b66-b0e4-f46d2172fea0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:49.279850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:49.280747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:49.281037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:49.281478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] PATH_INFO: `/v3/projects/6892278e7b824f0f9f428d335930e96c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:49.282697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6892278e7b824f0f9f428d335930e96c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:49.284703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:49.348207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6892278e7b824f0f9f428d335930e96c', 'request_id': 'req-c4671efb-2721-4ca2-9add-4e89b949046a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.356016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6892278e7b824f0f9f428d335930e96c', 'request_id': 'req-c4671efb-2721-4ca2-9add-4e89b949046a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.364446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6892278e7b824f0f9f428d335930e96c', 'request_id': 'req-c4671efb-2721-4ca2-9add-4e89b949046a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.375242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] The token cache is being invalidate because project 6892278e7b824f0f9f428d335930e96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:49.375538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.376589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.378616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 971/1922] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:49 2022] DELETE /identity/v3/projects/6892278e7b824f0f9f428d335930e96c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:49.382403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:49.392229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba72-e17f-4d80-8a22-849f28b28fe2 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:49.413748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:49.460072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:49.461063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:49.461411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:49.461754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] PATH_INFO: `/v3/users/5cccb107e129408483cf07125e7f6e90` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:49.462996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cccb107e129408483cf07125e7f6e90)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:49.465008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:49.515529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cccb107e129408483cf07125e7f6e90'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.524202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cccb107e129408483cf07125e7f6e90'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.537284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cccb107e129408483cf07125e7f6e90'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.538095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cccb107e129408483cf07125e7f6e90'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.545460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f1b3f6f1-dbbf-4c96-a3aa-37bb0b3648bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cccb107e129408483cf07125e7f6e90'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:49.552721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 952/1923] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:49 2022] DELETE /identity/v3/users/5cccb107e129408483cf07125e7f6e90 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:50.317330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.318851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:50.332169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4671efb-2721-4ca2-9add-4e89b949046a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.401355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.402234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.402522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.402804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] PATH_INFO: `/v3/projects/9d16d5219fae49ad9b3157e403b43e86` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.404035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d16d5219fae49ad9b3157e403b43e86)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.405936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.453798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:50.455901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d16d5219fae49ad9b3157e403b43e86', 'request_id': 'req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:50.463953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d16d5219fae49ad9b3157e403b43e86', 'request_id': 'req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:50.472270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d16d5219fae49ad9b3157e403b43e86', 'request_id': 'req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:50.482631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] The token cache is being invalidate because project 9d16d5219fae49ad9b3157e403b43e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:50.482918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:50.483591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3537e1d5-05cf-4955-b9d4-a9c3de853f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:50.485319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 972/1924] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:50 2022] DELETE /identity/v3/projects/9d16d5219fae49ad9b3157e403b43e86 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:50.491117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.491599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.491684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.511122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:50.512343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:50.572724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 953/1925] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:50.581781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.582103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.582387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.602723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:50.603846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:50.618708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 973/1926] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:50.623901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.634348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d27fe9-9a2b-4b38-b227-b1bfe7c8591c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.639030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.639713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.640002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.640291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.641139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:50.641449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.643276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.655827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 954/1927] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:50.660488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.669937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ede828-d175-478a-aac5-d06a064d8843 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.676428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.677098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.677384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.677663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.678382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.680307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.711920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 974/1928] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:50 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:50.713225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.723846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb42e2-a8ff-4b03-8b28-fa74c9111145 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.750645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:50.790232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.791212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.791636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.792018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.792944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.795057 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.817912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 955/1929] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:50 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:50.822015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.837985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef9fb-1ba7-4f58-8434-761cd55f7503 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.844459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.845279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.845597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.845876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.846614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.848267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.865707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 975/1930] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:50.867163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.878992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fbb91-0938-409e-9e14-6098c790d1ac admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.885980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456f9f7-2a51-4c53-b1af-267271a4bfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.886723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f9f7-2a51-4c53-b1af-267271a4bfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.887016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f9f7-2a51-4c53-b1af-267271a4bfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.887328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f9f7-2a51-4c53-b1af-267271a4bfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.888069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456f9f7-2a51-4c53-b1af-267271a4bfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.889691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456f9f7-2a51-4c53-b1af-267271a4bfe5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.900901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 956/1931] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:50.905471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:50.916257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de816df5-64ac-4c1a-9540-25f4c8afd1b7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:50.922356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:50.923314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.924146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.924433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] PATH_INFO: `/v3/projects/6ae3c8dbe2d0415c823cb76732f4dcb5/users/fbe4191263234dfa9a035dca48d22cae/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.942290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae3c8dbe2d0415c823cb76732f4dcb5, user_id=fbe4191263234dfa9a035dca48d22cae, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:50.945108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:50.962342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 976/1932] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:50 2022] PUT /identity/v3/projects/6ae3c8dbe2d0415c823cb76732f4dcb5/users/fbe4191263234dfa9a035dca48d22cae/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:50.968003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded2549-8a51-4a5b-a042-86152f1ec2cb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:50.968371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded2549-8a51-4a5b-a042-86152f1ec2cb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:50.968757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded2549-8a51-4a5b-a042-86152f1ec2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:50.989751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7ded2549-8a51-4a5b-a042-86152f1ec2cb None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:50.991082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ded2549-8a51-4a5b-a042-86152f1ec2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:51.073920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 957/1933] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:51.083775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:51.085446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:51.144324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6131e-880d-4c2c-a783-6d5e0fd4045c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:51.148047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:51.148707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:51.148992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:51.149269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:51.159835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:51.161278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:51.172481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 977/1934] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:52.064085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f494a3-eb35-4ed7-9937-83aca1ad44dd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:52.065148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f494a3-eb35-4ed7-9937-83aca1ad44dd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:52.065224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f494a3-eb35-4ed7-9937-83aca1ad44dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:52.092707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e4f494a3-eb35-4ed7-9937-83aca1ad44dd None None] MFA Rules not processed for user `fbe4191263234dfa9a035dca48d22cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:52.094952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e4f494a3-eb35-4ed7-9937-83aca1ad44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:52.170014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 958/1935] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:52.177913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:52.179812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:52.253468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bb534-14bc-408f-b0bc-1c0d876251c0 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:52.257455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd0a8f-ac69-4b7d-86ad-c19ad746088c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:52.257932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0a8f-ac69-4b7d-86ad-c19ad746088c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:52.258215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0a8f-ac69-4b7d-86ad-c19ad746088c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:52.258531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd0a8f-ac69-4b7d-86ad-c19ad746088c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:52.267417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd0a8f-ac69-4b7d-86ad-c19ad746088c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:52.268842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd0a8f-ac69-4b7d-86ad-c19ad746088c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:52.278268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 978/1936] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:53.604106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c91a8-a444-4d88-85d4-150ad6e3b1f6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:53.604604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c91a8-a444-4d88-85d4-150ad6e3b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:53.604739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c91a8-a444-4d88-85d4-150ad6e3b1f6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:53.606212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 959/1937] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:18:53.620335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:53.620876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:53.620967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:53.640201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:53.641408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:53.653667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:53.691194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c91a8-a444-4d88-85d4-150ad6e3b1f6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:53.693626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f55c91a8-a444-4d88-85d4-150ad6e3b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:53.718014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c91a8-a444-4d88-85d4-150ad6e3b1f6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:53.723217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:53.724391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:53.724856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:53.725276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] PATH_INFO: `/v3/users/b030be7717f44bf1937ae3b548f7f81b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:53.726167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 979/1938] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:53.727172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b030be7717f44bf1937ae3b548f7f81b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:53.729404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:53.740021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:53.752826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:53.767255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd6b33-44be-4c46-8d38-dc8460a20c19 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:53.770187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:53.773828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d32746-077b-4e21-899e-4682f84cec12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:53.774816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32746-077b-4e21-899e-4682f84cec12 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:53.775138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32746-077b-4e21-899e-4682f84cec12 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:53.775581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d32746-077b-4e21-899e-4682f84cec12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:53.784967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d32746-077b-4e21-899e-4682f84cec12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:53.786542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b030be7717f44bf1937ae3b548f7f81b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:53.787029 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d32746-077b-4e21-899e-4682f84cec12 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:53.795820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b030be7717f44bf1937ae3b548f7f81b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:53.799662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 980/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:53.800768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32502c4b-acf0-4953-9937-b2041461f775 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:53.801076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32502c4b-acf0-4953-9937-b2041461f775 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:53.801359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32502c4b-acf0-4953-9937-b2041461f775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:53.810363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b030be7717f44bf1937ae3b548f7f81b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:53.811128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b030be7717f44bf1937ae3b548f7f81b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:53.819391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-32502c4b-acf0-4953-9937-b2041461f775 None None] MFA Rules not processed for user `fbe4191263234dfa9a035dca48d22cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:53.819996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b030be7717f44bf1937ae3b548f7f81b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:53.820601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-32502c4b-acf0-4953-9937-b2041461f775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:53.827703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 960/1940] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:53 2022] DELETE /identity/v3/users/b030be7717f44bf1937ae3b548f7f81b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:53.827843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 981/1941] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:54.149139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.151195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:54.245613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c458e3c-4bc1-4d8a-9cba-e59506664886 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.250672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.251607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.253151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.253151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] PATH_INFO: `/v3/projects/1608785b7ce14af7a1c8efe2fcfb7a6c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.253935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1608785b7ce14af7a1c8efe2fcfb7a6c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.255975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.321172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1608785b7ce14af7a1c8efe2fcfb7a6c', 'request_id': 'req-259ac451-32ae-4371-b2cb-953edcf2828e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:54.337588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1608785b7ce14af7a1c8efe2fcfb7a6c', 'request_id': 'req-259ac451-32ae-4371-b2cb-953edcf2828e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:54.352009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1608785b7ce14af7a1c8efe2fcfb7a6c', 'request_id': 'req-259ac451-32ae-4371-b2cb-953edcf2828e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:54.369744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] The token cache is being invalidate because project 1608785b7ce14af7a1c8efe2fcfb7a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:54.370113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:54.370979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-259ac451-32ae-4371-b2cb-953edcf2828e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:54.375603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 961/1942] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:54 2022] DELETE /identity/v3/projects/1608785b7ce14af7a1c8efe2fcfb7a6c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:54.380479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.380781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.381147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.409913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:54.411336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:54.491177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 982/1943] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:54.505111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.505111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.505111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.528468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:54.529718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:54.567123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 962/1944] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:54.569187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.579562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce542-ae74-470c-b117-8d319477e2b3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.585035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.585710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.586000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.586280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.587008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:54.587362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.588960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.605199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 983/1945] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:18:54.609611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.620441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013a59-5392-49eb-86a1-a7fcd1ec3973 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.625460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.626224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.626651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.627002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.627841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.630150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.661194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 963/1946] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:54 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:54.665255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.675767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49baa24-d895-4aac-b076-ab94c31c570c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.737899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.738503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.738792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.739110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.739855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.741835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.762720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 984/1947] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:54 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:54.766745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.777797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa024ffa-9508-4a0c-8b26-648e026a9959 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.782343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.783081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.783394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.783780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.784662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.786446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.789305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:54.802686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 964/1948] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:54.803876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.814900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b794-5e94-41ee-a410-e003289587f4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.820042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160e4fe-b203-4cb8-8ffd-c64f657d6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.820756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e4fe-b203-4cb8-8ffd-c64f657d6bde admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.821020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e4fe-b203-4cb8-8ffd-c64f657d6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.821285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160e4fe-b203-4cb8-8ffd-c64f657d6bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.822012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160e4fe-b203-4cb8-8ffd-c64f657d6bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.823643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160e4fe-b203-4cb8-8ffd-c64f657d6bde admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.829422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:54.837007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 985/1949] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:18:54.841604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:54.851819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d0bb-64a4-4a0b-94e3-27882460a11e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:54.857130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:54.858234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.858695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.858976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] PATH_INFO: `/v3/projects/634316cd13dd4b4b81fbb6b98ee89837/users/92e5b1096fe449d78da5589957dc3ac0/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.873851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634316cd13dd4b4b81fbb6b98ee89837, user_id=92e5b1096fe449d78da5589957dc3ac0, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:54.876533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:54.890075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 965/1950] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:54 2022] PUT /identity/v3/projects/634316cd13dd4b4b81fbb6b98ee89837/users/92e5b1096fe449d78da5589957dc3ac0/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:54.901189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:54.901553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:54.901900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:54.929512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] MFA Rules not processed for user `92e5b1096fe449d78da5589957dc3ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:54.930781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:54.996015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 986/1951] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:55.007714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:55.009449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:55.090235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0123929-957a-4dbf-9933-b22c42615c58 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:55.102098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e5ee-9d2a-46d1-9940-1e337afca54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:55.102345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e5ee-9d2a-46d1-9940-1e337afca54b service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:55.102633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e5ee-9d2a-46d1-9940-1e337afca54b service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:55.102911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e5ee-9d2a-46d1-9940-1e337afca54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:55.112083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504e5ee-9d2a-46d1-9940-1e337afca54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:55.113683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504e5ee-9d2a-46d1-9940-1e337afca54b service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:55.125267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 966/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:58.207772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:58.278829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefadc7-f142-433b-8698-9a9ce824847d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:58.283368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:58.284293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.284528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.284808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] PATH_INFO: `/v3/users/92e5b1096fe449d78da5589957dc3ac0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.285993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e5b1096fe449d78da5589957dc3ac0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:58.287926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:58.340906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e5b1096fe449d78da5589957dc3ac0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.348776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e5b1096fe449d78da5589957dc3ac0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.349515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e5b1096fe449d78da5589957dc3ac0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.362731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e5b1096fe449d78da5589957dc3ac0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.363527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e5b1096fe449d78da5589957dc3ac0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.377477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 987/1953] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:58 2022] DELETE /identity/v3/users/92e5b1096fe449d78da5589957dc3ac0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:58.381864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.382426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.382693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.402244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:58.403480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.459871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:58.461261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.469048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 967/1954] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:58.474529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f27fb-e84e-47d1-9f26-36b47ce19e2d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:58.478343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:58.479418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:58.479645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.480303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.480591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.480871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] PATH_INFO: `/v3/users/0ab148966bf94ed1ade23d6cb2e88789` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.482057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab148966bf94ed1ade23d6cb2e88789)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:58.484013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:58.487747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:58.536004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab148966bf94ed1ade23d6cb2e88789'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.543335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab148966bf94ed1ade23d6cb2e88789'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.543962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab148966bf94ed1ade23d6cb2e88789'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.544128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeae07-f853-49ad-b3a0-a951841a639f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:58.547707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:58.548380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.549258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.549540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.551345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.557053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab148966bf94ed1ade23d6cb2e88789'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.557707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4bbb3c22-e2ba-4d6e-92ac-86e03f98f452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab148966bf94ed1ade23d6cb2e88789'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:58.564567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:58.565915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:58.570133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 988/1955] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:58 2022] DELETE /identity/v3/users/0ab148966bf94ed1ade23d6cb2e88789 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:58.574352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.574647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.574935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.576122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 968/1956] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:18:58.591689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:58.592884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.656064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 989/1957] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:18:58.666248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:58.667700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.675588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:58.682568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befff16d-9894-4192-bf40-1744391f7e9e service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:58.743997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab084d-024a-4e31-be51-c4f478f7f9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:58.744661 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab084d-024a-4e31-be51-c4f478f7f9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.745004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab084d-024a-4e31-be51-c4f478f7f9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.745562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab084d-024a-4e31-be51-c4f478f7f9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.756712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab084d-024a-4e31-be51-c4f478f7f9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:58.758236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab084d-024a-4e31-be51-c4f478f7f9b8 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:58.768901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 969/1958] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:18:58.922747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:58.924468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:58.937287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3941e-7c12-47d1-a2af-c93c24cbfb50 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:58.943571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:58.944627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:58.945057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:58.945527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] PATH_INFO: `/v3/projects/634316cd13dd4b4b81fbb6b98ee89837` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:58.946881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=634316cd13dd4b4b81fbb6b98ee89837)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:58.949066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.009590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634316cd13dd4b4b81fbb6b98ee89837', 'request_id': 'req-2f3f0101-267b-43f7-95af-7f7150758a88'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.016863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634316cd13dd4b4b81fbb6b98ee89837', 'request_id': 'req-2f3f0101-267b-43f7-95af-7f7150758a88'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.026089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634316cd13dd4b4b81fbb6b98ee89837', 'request_id': 'req-2f3f0101-267b-43f7-95af-7f7150758a88'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.037812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] The token cache is being invalidate because project 634316cd13dd4b4b81fbb6b98ee89837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:59.038088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.038752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2f3f0101-267b-43f7-95af-7f7150758a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.040716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 990/1959] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:58 2022] DELETE /identity/v3/projects/634316cd13dd4b4b81fbb6b98ee89837 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:59.045883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.046195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.046479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.066463 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:59.067702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.131781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 970/1960] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:59.140227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.140884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.141013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.151590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:59.156776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.158843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.186965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:59.188264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.199083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 991/1961] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:59.202931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.203617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78de319-8523-42cb-95df-c5f3e4f4c704 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.210243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.211204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.211681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.212147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] PATH_INFO: `/v3/projects/b00cf2b4bad54a28abb6efdce95a8b04` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.214996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00cf2b4bad54a28abb6efdce95a8b04)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.215231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c557a-1cc3-4e2d-aae8-ee68ee3663f4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.217154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.221267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.222002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.222512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.222801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.223828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:18:59.224194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.226007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.242009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 992/1962] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:18:59.247438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.263440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b96d0-de98-4108-8093-2d57229a647a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.282920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00cf2b4bad54a28abb6efdce95a8b04', 'request_id': 'req-bca5be64-3c94-4dc3-9a7b-21c85720c835'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.296568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00cf2b4bad54a28abb6efdce95a8b04', 'request_id': 'req-bca5be64-3c94-4dc3-9a7b-21c85720c835'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.307303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00cf2b4bad54a28abb6efdce95a8b04', 'request_id': 'req-bca5be64-3c94-4dc3-9a7b-21c85720c835'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.324272 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] The token cache is being invalidate because project b00cf2b4bad54a28abb6efdce95a8b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:18:59.324659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.326267 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.328388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 971/1963] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:59 2022] DELETE /identity/v3/projects/b00cf2b4bad54a28abb6efdce95a8b04 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:59.333298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.335890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.363945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.364882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.365791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.366928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.368039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.379482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.384626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:59.428085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 993/1964] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:59 2022] POST /identity/v3/projects => generated 405 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:18:59.432887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.437185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5be64-3c94-4dc3-9a7b-21c85720c835 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.451949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.511627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.512798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.513232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.513665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] PATH_INFO: `/v3/users/a365f9ee9f6447529d6d0407c858d7df` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.515031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a365f9ee9f6447529d6d0407c858d7df)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.517202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.518631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46da2a1-83da-442d-aced-6229e950682c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.523654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.524323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.524610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.524895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.525596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.527540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.555019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 994/1965] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:18:59 2022] POST /identity/v3/users => generated 303 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:18:59.556370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.567183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e51d-ee29-4a6e-af08-2b408553a5ae admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.572250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.572928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.573043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a365f9ee9f6447529d6d0407c858d7df'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.573342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.573639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.574462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.576041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.583166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a365f9ee9f6447529d6d0407c858d7df'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.590697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 995/1966] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:59.591655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.596572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a365f9ee9f6447529d6d0407c858d7df'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.597364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a365f9ee9f6447529d6d0407c858d7df'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.604004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d4ff1-68b4-478e-b469-03d81eb0bc9c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.604868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a365f9ee9f6447529d6d0407c858d7df'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:18:59.610020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80aca6-9890-4054-b017-1066a304d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.610767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80aca6-9890-4054-b017-1066a304d65d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.612088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80aca6-9890-4054-b017-1066a304d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.612219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 972/1967] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:18:59 2022] DELETE /identity/v3/users/a365f9ee9f6447529d6d0407c858d7df => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:18:59.612319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80aca6-9890-4054-b017-1066a304d65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.612921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80aca6-9890-4054-b017-1066a304d65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.614572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80aca6-9890-4054-b017-1066a304d65d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.625790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 996/1968] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:18:59.630319 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.631774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.701487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:59.709386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e81b6-afdd-418e-b7c2-07771e4742e7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.718131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.719288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.719958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.720471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] PATH_INFO: `/v3/projects/445fd6c577e046cf99780ace65722b88/users/b382a06c8d4b43b3936a2a17193dd41c/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.738433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445fd6c577e046cf99780ace65722b88, user_id=b382a06c8d4b43b3936a2a17193dd41c, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.741281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.759858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 973/1969] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:18:59 2022] PUT /identity/v3/projects/445fd6c577e046cf99780ace65722b88/users/b382a06c8d4b43b3936a2a17193dd41c/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:18:59.771822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.773247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.773630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.809888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] MFA Rules not processed for user `b382a06c8d4b43b3936a2a17193dd41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:18:59.811124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.839964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:18:59.880735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 997/1970] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:18:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:18:59.885317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.910543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:18:59.912220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:18:59.962205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02718e-d264-4daf-b15b-b1133b2808d5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.967105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.967777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.968055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.968339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.969112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:18:59.971079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:18:59.988968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffbc0f-fb17-445b-bbb8-c57631e92650 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:18:59.994567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:18:59.995632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:18:59.995910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:18:59.996355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] PATH_INFO: `/v3/projects/a0a68daef5b344fcaa164fb6859cd378` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:18:59.998105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a68daef5b344fcaa164fb6859cd378)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.000626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.006306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 974/1971] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:18:59 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:00.010117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.063101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a68daef5b344fcaa164fb6859cd378', 'request_id': 'req-4e67bf08-16e1-44e9-a3d3-52dcef83c278'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.074613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a68daef5b344fcaa164fb6859cd378', 'request_id': 'req-4e67bf08-16e1-44e9-a3d3-52dcef83c278'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.081502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee8b1d-d6dc-4bc8-aca5-24d2667dd6eb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.082794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a68daef5b344fcaa164fb6859cd378', 'request_id': 'req-4e67bf08-16e1-44e9-a3d3-52dcef83c278'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.098047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] The token cache is being invalidate because project a0a68daef5b344fcaa164fb6859cd378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:00.098047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.098047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.099015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 998/1972] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:18:59 2022] DELETE /identity/v3/projects/a0a68daef5b344fcaa164fb6859cd378 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:00.099844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.101178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.142195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d188530-4d91-430e-bd72-81ab368ea1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.142872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188530-4d91-430e-bd72-81ab368ea1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.143223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188530-4d91-430e-bd72-81ab368ea1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.143507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d188530-4d91-430e-bd72-81ab368ea1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.144213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188530-4d91-430e-bd72-81ab368ea1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.146134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d188530-4d91-430e-bd72-81ab368ea1e8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.161853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:00.165459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:00.169045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67bf08-16e1-44e9-a3d3-52dcef83c278 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.171288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 975/1973] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:00.172942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.173175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.174107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.175946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.176865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.177449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.178069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] PATH_INFO: `/v3/users/6658c81d06bd494ca6f0afe4b6b03995` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.179662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6658c81d06bd494ca6f0afe4b6b03995)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.181564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.192149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:00.193361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.207128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 976/1974] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:00.207128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.207128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.219368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550f5f3-f7b3-443c-be4d-9f7a02c28fd4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.225730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88939125-a6c5-4acd-8b91-a6881857be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.226416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88939125-a6c5-4acd-8b91-a6881857be12 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.226688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88939125-a6c5-4acd-8b91-a6881857be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.226965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88939125-a6c5-4acd-8b91-a6881857be12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.227741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88939125-a6c5-4acd-8b91-a6881857be12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.229659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88939125-a6c5-4acd-8b91-a6881857be12 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.237989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6658c81d06bd494ca6f0afe4b6b03995'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.242380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 977/1975] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:00.242380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.242616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.242814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.246956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6658c81d06bd494ca6f0afe4b6b03995'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.247683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6658c81d06bd494ca6f0afe4b6b03995'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.260427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6658c81d06bd494ca6f0afe4b6b03995'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.260615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:00.261110 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6658c81d06bd494ca6f0afe4b6b03995'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:00.261642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.269535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 978/1976] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:00.270344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.271600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.273554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 999/1977] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:00 2022] DELETE /identity/v3/users/6658c81d06bd494ca6f0afe4b6b03995 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:00.274343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.283937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f66ee-085b-49cd-b8b1-bf81dc0f6bf6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.335404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980cf6c-8e77-4030-ac98-2375caa5c4ba admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.340084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.340776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.341061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.341349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.342199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:00.342390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.344967 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde93fd-1789-425d-b0fd-2db63f196638 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.347823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.348872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.349165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.349446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] PATH_INFO: `/v3/projects/45458f8baf63484d8e0f9a7f09d697e0/users/e3a10b04ff2944709b1105f3204bc76e/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.362079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1000/1978] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:19:00.362079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.362079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.362079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.365785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45458f8baf63484d8e0f9a7f09d697e0, user_id=e3a10b04ff2944709b1105f3204bc76e, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.369186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.379160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:00.380364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.382841 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 979/1979] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:00 2022] PUT /identity/v3/projects/45458f8baf63484d8e0f9a7f09d697e0/users/e3a10b04ff2944709b1105f3204bc76e/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:00.386585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.444961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1001/1980] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:00.445906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.453386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeccae-4801-4a5b-b681-054595c2d78d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.455885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99465c-e989-4f84-bad3-0597c7410b7c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.460634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.461306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.461597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.461880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.462183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.462579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.462910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.463263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.463573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.464300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.464522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.466055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.472701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:00.478744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1002/1981] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:00.479849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.482269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.502350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 980/1982] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:00.503812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.553314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff598e-3a89-4e59-aece-c8547b4065da admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.568193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:00.590094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6602c9-9343-4879-bcdb-4bd19938dae9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.596087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.596926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.597216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.597493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] PATH_INFO: `/v3/projects/45458f8baf63484d8e0f9a7f09d697e0/users/e3a10b04ff2944709b1105f3204bc76e/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.599923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45458f8baf63484d8e0f9a7f09d697e0, user_id=e3a10b04ff2944709b1105f3204bc76e, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.613491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.628153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177eca39-a1aa-4131-9928-e8281d0f21a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.629419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eca39-a1aa-4131-9928-e8281d0f21a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.629856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eca39-a1aa-4131-9928-e8281d0f21a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.630282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177eca39-a1aa-4131-9928-e8281d0f21a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.644014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 981/1983] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:00 2022] PUT /identity/v3/projects/45458f8baf63484d8e0f9a7f09d697e0/users/e3a10b04ff2944709b1105f3204bc76e/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:00.644300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177eca39-a1aa-4131-9928-e8281d0f21a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.644860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.646148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177eca39-a1aa-4131-9928-e8281d0f21a3 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.661053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1003/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:00.662953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.663337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.663910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.732992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] MFA Rules not processed for user `e3a10b04ff2944709b1105f3204bc76e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:00.734684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.754775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e52a5-97a4-4fa8-bd92-d60b4a29ec1a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.762156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.763194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.763652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.764108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.765535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.769241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.801250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 982/1985] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:00.805114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.818133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb25c-1c4b-4673-9109-196e8b786c06 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.825404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.826219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.826604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.827028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.827946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.830340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.842516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1004/1986] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:00.847578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 983/1987] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:00.851875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.855777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.858147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:00.866637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d381e-e0fc-41a8-9123-e3dfcf43df43 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.872634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.873941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.873941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.874750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.875777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.878334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.891175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1005/1988] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:00.898016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:00.914631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751f665-42ae-460e-84d3-13464b5340a8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.922370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b78afc-a00f-449e-a696-bb76af1f9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.923408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78afc-a00f-449e-a696-bb76af1f9c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.923740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78afc-a00f-449e-a696-bb76af1f9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.924027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b78afc-a00f-449e-a696-bb76af1f9c37 admin admin] PATH_INFO: `/v3/projects/e6b76bb8784a453d898b0751f0a3086a/users/8c35c326c5e3488eb406aab41bd433a5/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.950500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b78afc-a00f-449e-a696-bb76af1f9c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b76bb8784a453d898b0751f0a3086a, user_id=8c35c326c5e3488eb406aab41bd433a5, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.951064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8dd5b-9986-4f52-87f0-e9d6c4d31734 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:00.953876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b78afc-a00f-449e-a696-bb76af1f9c37 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.957138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:00.958091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.958382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.960114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.976334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:00.977793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:00.983138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1006/1989] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:00 2022] PUT /identity/v3/projects/e6b76bb8784a453d898b0751f0a3086a/users/8c35c326c5e3488eb406aab41bd433a5/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:00.991500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:00.991794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:00.992079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:00.994953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 984/1990] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:01.018964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:01.035518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] MFA Rules not processed for user `8c35c326c5e3488eb406aab41bd433a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:01.037238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.069701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.071479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.094720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801893-3e72-41ab-8aa8-9bddbc2ceba5 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.153002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1007/1991] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:01.157751 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.218010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.218887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.219537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.219537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] PATH_INFO: `/v3/projects/3ec70aa163d1447d99f7ac512c7ea528` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.220695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec70aa163d1447d99f7ac512c7ea528)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.222917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.224550 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:01.243028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332b513-c3c5-4ad9-9325-ec721187afa3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.248218 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.249013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.249792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.250173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.250927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.253848 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.274863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec70aa163d1447d99f7ac512c7ea528', 'request_id': 'req-5478470c-6993-4678-9cf9-91c79105916e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.280160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1008/1992] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:01.280917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.282548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec70aa163d1447d99f7ac512c7ea528', 'request_id': 'req-5478470c-6993-4678-9cf9-91c79105916e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.289961 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec70aa163d1447d99f7ac512c7ea528', 'request_id': 'req-5478470c-6993-4678-9cf9-91c79105916e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.301355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] The token cache is being invalidate because project 3ec70aa163d1447d99f7ac512c7ea528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:01.301645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.302321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.303936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 985/1993] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:01 2022] DELETE /identity/v3/projects/3ec70aa163d1447d99f7ac512c7ea528 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:01.307172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.307172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.345081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9d381-58e5-4be8-9955-55c2404e9b19 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.350505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.351375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.351665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.351949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] PATH_INFO: `/v3/users/b382a06c8d4b43b3936a2a17193dd41c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.353154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b382a06c8d4b43b3936a2a17193dd41c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.355108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.373333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478470c-6993-4678-9cf9-91c79105916e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.380816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e14470-d527-4f1a-b7b5-3ab6d75b124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.381579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e14470-d527-4f1a-b7b5-3ab6d75b124d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.381904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e14470-d527-4f1a-b7b5-3ab6d75b124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.382186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e14470-d527-4f1a-b7b5-3ab6d75b124d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.383151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e14470-d527-4f1a-b7b5-3ab6d75b124d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.385165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e14470-d527-4f1a-b7b5-3ab6d75b124d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.385582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:01.408539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 986/1994] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:01.409068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b382a06c8d4b43b3936a2a17193dd41c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.409171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.409171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.409171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.416587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b382a06c8d4b43b3936a2a17193dd41c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.417303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b382a06c8d4b43b3936a2a17193dd41c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.429854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:01.431179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.431652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b382a06c8d4b43b3936a2a17193dd41c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.432352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-58b5bef0-6a65-4288-8b3f-3b2d99ed43a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b382a06c8d4b43b3936a2a17193dd41c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:01.440849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 987/1995] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:01.441835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.448124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.449253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1009/1996] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:01 2022] DELETE /identity/v3/users/b382a06c8d4b43b3936a2a17193dd41c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:01.450375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80626-e36e-4afa-8a13-25c5c30de3bb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.450671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80626-e36e-4afa-8a13-25c5c30de3bb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.450961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80626-e36e-4afa-8a13-25c5c30de3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.463812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43105b58-d0cf-4694-88e9-36df73dc69ff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.471462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aec80626-e36e-4afa-8a13-25c5c30de3bb None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:01.472719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aec80626-e36e-4afa-8a13-25c5c30de3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.529220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.529887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.530174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.530451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.531266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.533509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.539470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1010/1997] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:01.544017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.544545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.544672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 988/1998] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:01.545041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.545297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.556195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69eabbb-4996-4c22-9d20-ddd02ded131f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.561546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.562185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.562573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.562959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.563848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:01.564284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.564407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:01.565504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.566360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.574086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1011/1999] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:01.575241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:01.577992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.582285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 989/2000] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:19:01.587147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.589493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f70c4-be7a-4eb7-9651-9a97f9157bfb None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.594521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.595845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.596237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.596615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.597422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.599176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.600637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d4de6-b70b-4633-bba8-2c0e555fd09d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.606407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.608468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.608798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.609146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.610333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.614336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.615231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1012/2001] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:01.616343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.618040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.644377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 990/2002] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:01.644377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.680982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df6b1c-30ea-4b01-8180-e43b979a9167 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.708650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fd33e-c6b8-4fb2-ae0f-082c6b99624a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.713699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.714592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.714878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.715195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] PATH_INFO: `/v3/projects/bce135d550e1478db1d678dbbcc46ada/users/1c3713e6f98a4dec853eee6433b3dd2b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.730548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:01.736807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce135d550e1478db1d678dbbcc46ada, user_id=1c3713e6f98a4dec853eee6433b3dd2b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.740491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.746208 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab922c9-8d32-4c40-aeba-23e5f7247a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.747249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab922c9-8d32-4c40-aeba-23e5f7247a29 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.748483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab922c9-8d32-4c40-aeba-23e5f7247a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.750757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab922c9-8d32-4c40-aeba-23e5f7247a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.763405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab922c9-8d32-4c40-aeba-23e5f7247a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.764892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab922c9-8d32-4c40-aeba-23e5f7247a29 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.768734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 991/2003] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:01 2022] PUT /identity/v3/projects/bce135d550e1478db1d678dbbcc46ada/users/1c3713e6f98a4dec853eee6433b3dd2b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:01.769647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.786213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1013/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:01.787247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.787622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.787942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.822509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] MFA Rules not processed for user `1c3713e6f98a4dec853eee6433b3dd2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:01.823799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:01.887989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b7b28-8af6-4c14-a88b-5a84d33f2eaf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.900360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.901858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.902362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.903323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.905151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.910146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.924559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1014/2005] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:01.929580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.941209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 992/2006] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:01.945678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:01.947747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b462eb0-20ae-4a25-8252-df6169022e92 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.956556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e270e-0301-4c22-b383-9126ad12bd18 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:01.969098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.969891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.970798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.971279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.972528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.972647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:01.972832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:01.973116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:01.973391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:01.974095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:01.974203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.976049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:01.989128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 993/2007] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:02.000026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.017862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce76604-8d8c-435d-955b-cc7d0c89403a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.023100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1015/2008] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:01 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:02.024686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.025501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.026283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.026810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.027253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.028140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.030047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.043073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 994/2009] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:02.046939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.058327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e94340-b70f-4908-8176-71d00d6bcfff admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.081297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:02.098008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf805006-a326-4402-b93c-3c31d34bc996 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.103763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.104309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.104692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.105076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.106203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.107924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.125117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.126101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.126400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.126712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] PATH_INFO: `/v3/projects/66e38c079cef4121bb77077dc68ad860/users/9d3b868d98c34daf9b05e3a6302abba4/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.135463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1016/2010] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:02 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:02.138163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.146252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e38c079cef4121bb77077dc68ad860, user_id=9d3b868d98c34daf9b05e3a6302abba4, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.148945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d87b4-d395-47ee-bf6f-1206fa7ed2f0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.150529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.153826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.154506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.154795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.155211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.156011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.157633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.168807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 995/2011] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:02 2022] PUT /identity/v3/projects/66e38c079cef4121bb77077dc68ad860/users/9d3b868d98c34daf9b05e3a6302abba4/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:02.169772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.170785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1017/2012] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:02.174329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.174739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.186735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d597be-8566-4007-a826-4f68bc56aa5b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.217402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:02.245020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a8f98-50bc-444d-a523-ef575024071c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.249745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.250610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.250899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.251210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] PATH_INFO: `/v3/projects/445fd6c577e046cf99780ace65722b88` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.253000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445fd6c577e046cf99780ace65722b88)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.254630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb305-8670-4019-8644-7f3adebf3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.255205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.255667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb305-8670-4019-8644-7f3adebf3e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.255959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb305-8670-4019-8644-7f3adebf3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.256259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb305-8670-4019-8644-7f3adebf3e33 admin admin] PATH_INFO: `/v3/projects/adab8621e7ce4ec7af80c390216ff2e4/users/d928f67681794e5d82191ac44fe3e92f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.272369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb305-8670-4019-8644-7f3adebf3e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adab8621e7ce4ec7af80c390216ff2e4, user_id=d928f67681794e5d82191ac44fe3e92f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.275030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cb305-8670-4019-8644-7f3adebf3e33 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.288555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1018/2013] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:02 2022] PUT /identity/v3/projects/adab8621e7ce4ec7af80c390216ff2e4/users/d928f67681794e5d82191ac44fe3e92f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:02.289818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.290178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.290527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.304685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445fd6c577e046cf99780ace65722b88', 'request_id': 'req-e418a240-9884-4921-ad82-906a7d8cc297'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.312514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445fd6c577e046cf99780ace65722b88', 'request_id': 'req-e418a240-9884-4921-ad82-906a7d8cc297'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.318181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] MFA Rules not processed for user `9d3b868d98c34daf9b05e3a6302abba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:02.319310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445fd6c577e046cf99780ace65722b88', 'request_id': 'req-e418a240-9884-4921-ad82-906a7d8cc297'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.319429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.330247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] The token cache is being invalidate because project 445fd6c577e046cf99780ace65722b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:02.330543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.331244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.332852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 996/2014] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:02 2022] DELETE /identity/v3/projects/445fd6c577e046cf99780ace65722b88 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:02.335686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.335686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.378089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:02.387259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1019/2015] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:02.388088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.389364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.406385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a240-9884-4921-ad82-906a7d8cc297 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.411302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.411973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.412256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.412583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.413344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.414934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.425934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 997/2016] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:02.426816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.428487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.443511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cda0e-8031-4208-97c7-9e4e0596b6a5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.448810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.449823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.450182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.450462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.451182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.453373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.460488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4967c48-489a-41e4-bd01-f98b2109ecf5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.465239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.466255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.466545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.466831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] PATH_INFO: `/v3/users/e3a10b04ff2944709b1105f3204bc76e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.468207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a10b04ff2944709b1105f3204bc76e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.471159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.479975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 998/2017] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:02 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:02.480761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.520497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:02.522143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a10b04ff2944709b1105f3204bc76e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.531714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a10b04ff2944709b1105f3204bc76e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.532351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a10b04ff2944709b1105f3204bc76e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.545423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a10b04ff2944709b1105f3204bc76e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.546094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a10b04ff2944709b1105f3204bc76e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:02.548316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ab32e-ab74-4540-ab3c-7eb05909af93 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.553065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8edbb-290e-4f97-b772-f2f2e58d48f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.553956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8edbb-290e-4f97-b772-f2f2e58d48f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.554251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8edbb-290e-4f97-b772-f2f2e58d48f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.554540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8edbb-290e-4f97-b772-f2f2e58d48f1 admin admin] PATH_INFO: `/v3/projects/adab8621e7ce4ec7af80c390216ff2e4/users/d928f67681794e5d82191ac44fe3e92f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.556581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8edbb-290e-4f97-b772-f2f2e58d48f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adab8621e7ce4ec7af80c390216ff2e4, user_id=d928f67681794e5d82191ac44fe3e92f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.559287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8edbb-290e-4f97-b772-f2f2e58d48f1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.559856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1020/2018] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:02 2022] DELETE /identity/v3/users/e3a10b04ff2944709b1105f3204bc76e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:02.560620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.561924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.574977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 999/2019] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:02 2022] PUT /identity/v3/projects/adab8621e7ce4ec7af80c390216ff2e4/users/d928f67681794e5d82191ac44fe3e92f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:02.585950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.586370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.586528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.635215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] MFA Rules not processed for user `d928f67681794e5d82191ac44fe3e92f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:02.636752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.672562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4343c60-2d5e-43cd-a5b2-9df77f4a9c22 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.759421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1000/2020] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:02.771516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.774592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.783139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.784206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.784653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.785886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.787680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.791298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.825087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1021/2021] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:02 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:02.829255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.832769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:02.869065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867c27b-984d-4298-bfff-068ad1d16654 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.872867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c473b98-1725-4cbe-bcf4-c76db30eda12 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.881183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.881944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.883573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.884213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.884685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.885422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.885964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.886311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.887480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.889782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.908105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1022/2022] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:02.909241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.918179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:02.930679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.932447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.935206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8917e1-2b88-43b2-bd0b-881434271fdb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:02.942973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:02.943913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:02.944235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:02.944483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] PATH_INFO: `/v3/projects/45458f8baf63484d8e0f9a7f09d697e0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:02.945956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45458f8baf63484d8e0f9a7f09d697e0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:02.948240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:02.965941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1001/2023] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:02.967623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:02.985599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567d16c-bd8f-4939-a4ab-8e5f1a60430e service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.003125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.006098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.009652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.010378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.013306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.016240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.029411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1002/2024] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:03.031718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:03.034391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.040579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45458f8baf63484d8e0f9a7f09d697e0', 'request_id': 'req-0d3623ab-de5f-404f-b402-6e67522c5df2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:03.056558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910c075-3a3c-49f3-81ba-767698606dc9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.070778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45458f8baf63484d8e0f9a7f09d697e0', 'request_id': 'req-0d3623ab-de5f-404f-b402-6e67522c5df2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:03.081779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45458f8baf63484d8e0f9a7f09d697e0', 'request_id': 'req-0d3623ab-de5f-404f-b402-6e67522c5df2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:03.107253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] The token cache is being invalidate because project 45458f8baf63484d8e0f9a7f09d697e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:03.107549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:03.108239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-0d3623ab-de5f-404f-b402-6e67522c5df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:03.109824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1023/2025] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:02 2022] DELETE /identity/v3/projects/45458f8baf63484d8e0f9a7f09d697e0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:03.115452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affb8c3-90e7-480e-8ba7-e1b5aac652da None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.115754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affb8c3-90e7-480e-8ba7-e1b5aac652da None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.116039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affb8c3-90e7-480e-8ba7-e1b5aac652da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.151817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5affb8c3-90e7-480e-8ba7-e1b5aac652da None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:03.153141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5affb8c3-90e7-480e-8ba7-e1b5aac652da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.188162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1a780-bf29-4983-8ab5-fd782f6dc448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.188836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a780-bf29-4983-8ab5-fd782f6dc448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.189250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a780-bf29-4983-8ab5-fd782f6dc448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.189537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1a780-bf29-4983-8ab5-fd782f6dc448 admin admin] PATH_INFO: `/v3/projects/74f27bb3abeb4a7091e9be7cfa42e557/users/1e4e678093144c48b9c569b7444d4548/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.215874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1a780-bf29-4983-8ab5-fd782f6dc448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f27bb3abeb4a7091e9be7cfa42e557, user_id=1e4e678093144c48b9c569b7444d4548, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.218667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1a780-bf29-4983-8ab5-fd782f6dc448 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.234470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1003/2026] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:03 2022] PUT /identity/v3/projects/74f27bb3abeb4a7091e9be7cfa42e557/users/1e4e678093144c48b9c569b7444d4548/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:03.245814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.246103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.246379 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.274008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1024/2027] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:03.281398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] MFA Rules not processed for user `1e4e678093144c48b9c569b7444d4548`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:03.283548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.284441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.285006 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.285688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.318436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:03.320402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.398785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1004/2028] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:03.402863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.404520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.407348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1025/2029] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:03.411845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.419854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f035e-cb52-45e3-992d-5ba273faaac5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.421023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d737f6-17e5-4218-b07d-b01aff234fc9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.424804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.425351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.425472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.425748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.426029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.426131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.426488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.427105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.427230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.427595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:03.427906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.428670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.429483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.447117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1026/2030] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:19:03.450446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.461509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae4fb-2b94-4c40-94b0-1b92ffd0b1a3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.468445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1005/2031] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:03.468607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.468607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.468607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.468607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.469447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.470187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.472487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.486539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:03.505185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1027/2032] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:03.506455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.546679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e579-fa45-4eda-86e0-4e1464c71a4a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.552419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:03.577171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062fd3-412b-4e96-8357-a4d808e7c9bb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.582625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.583444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.583734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.584031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.584924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.587592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.611761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1028/2033] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:03.613650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.614333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.614896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.615403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.615510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.616340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.618318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.625746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a503-85cb-4911-a45b-72d93160399c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.630893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.631637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.631938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.632197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.632990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.634601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.643363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1006/2034] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:03.646053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1029/2035] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:03.646971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.649690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.657542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8e385-0a43-4628-bb3d-9cb32dd118a3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.672448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed58e8-0524-44f8-b5c4-e18792ef0dfb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.672572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.672572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.672572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.672572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.672858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.672858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.672986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.672986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.672986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.672986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.673268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.673268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.677893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1007/2036] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:03.682076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.683547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1030/2037] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:03.688497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.694190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607318db-371e-4dee-aa4d-3f2fadcf75a2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.698875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af0dce-a673-472f-909e-ade88991082e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.699132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.700023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.700307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.700589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] PATH_INFO: `/v3/projects/b52100575829464d84b02e3e16ffc5cf/users/c868916b147a406582a5c965dca9a261/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.703946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.705497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.705781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.706058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] PATH_INFO: `/v3/projects/2c3e09afff93435da9d99b98628dab64/users/66c3cd285c75492cb6e04f894c9ac119/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.716680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52100575829464d84b02e3e16ffc5cf, user_id=c868916b147a406582a5c965dca9a261, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.719377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.722979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3e09afff93435da9d99b98628dab64, user_id=66c3cd285c75492cb6e04f894c9ac119, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.725867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.736732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1008/2038] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:03 2022] PUT /identity/v3/projects/b52100575829464d84b02e3e16ffc5cf/users/c868916b147a406582a5c965dca9a261/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:03.740159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1031/2039] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:03 2022] PUT /identity/v3/projects/2c3e09afff93435da9d99b98628dab64/users/66c3cd285c75492cb6e04f894c9ac119/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:03.740989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.748674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.752223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.810730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2473fcf-8beb-45a7-843a-492c2ff89f71 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.810934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cced92c-7c32-42e2-9ddb-54542c93d109 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.815216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.815998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.816287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.816567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.818375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.830485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:03.870586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ef26e-607c-4301-8d00-5bd04474acf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.871311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ef26e-607c-4301-8d00-5bd04474acf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.871600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ef26e-607c-4301-8d00-5bd04474acf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.871886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ef26e-607c-4301-8d00-5bd04474acf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.872688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ef26e-607c-4301-8d00-5bd04474acf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.874293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ef26e-607c-4301-8d00-5bd04474acf9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.878334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.879861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.884922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1009/2040] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:03.886058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.886349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.886755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.889246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1032/2041] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:03.890055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:03.901023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e96e6a-927b-40d2-be7b-7d1ecbc9db7e service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:03.905670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107c406-9ce5-4b30-a93f-339c96b6877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:03.906551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c406-9ce5-4b30-a93f-339c96b6877e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.906859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c406-9ce5-4b30-a93f-339c96b6877e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.907168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c406-9ce5-4b30-a93f-339c96b6877e admin admin] PATH_INFO: `/v3/projects/b52100575829464d84b02e3e16ffc5cf/users/c868916b147a406582a5c965dca9a261/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.909147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c406-9ce5-4b30-a93f-339c96b6877e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52100575829464d84b02e3e16ffc5cf, user_id=c868916b147a406582a5c965dca9a261, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:03.911857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c406-9ce5-4b30-a93f-339c96b6877e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:03.914517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] MFA Rules not processed for user `66c3cd285c75492cb6e04f894c9ac119`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:03.915839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.922578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1033/2042] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:03 2022] PUT /identity/v3/projects/b52100575829464d84b02e3e16ffc5cf/users/c868916b147a406582a5c965dca9a261/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:03.933833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:03.934131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:03.934769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:03.965406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] MFA Rules not processed for user `c868916b147a406582a5c965dca9a261`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:03.966938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:03.980243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:04.000196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1010/2043] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:04.005946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.067908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1034/2044] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:04.081603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.083975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:04.084094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb3117-e02e-4d73-96ae-cdbf3258625d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.088923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.089597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.090428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.090718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.091628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.093659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.132598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1011/2045] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:04 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:04.136876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.169598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4d5c2-59fb-4622-93e5-8c9df4ccd923 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.196096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:04.254731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a1165-dda4-4fb0-9da5-edddfc3aa9b5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.265831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.265831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.265831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.265831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.266834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.266834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.274160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.274894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.275324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.275650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.278163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:04.294597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1012/2046] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:04 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:04.300258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.313627 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc1293-5dcc-4bc7-9a41-c4cb9c240070 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.319664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.320344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.320636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.320962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.321829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.323888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.337455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1013/2047] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:04.341978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.361645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8782-9865-4cfe-9c1d-c72b4c398be8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.373287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.374889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.379343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.383477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.383477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.383477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] PATH_INFO: `/v3/projects/a4d8f5626539442695807128cfd76242/users/7654579aec224c159e275c805f7dee36/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.390195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1035/2048] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:04.401449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d8f5626539442695807128cfd76242, user_id=7654579aec224c159e275c805f7dee36, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.405261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.426537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1014/2049] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:04 2022] PUT /identity/v3/projects/a4d8f5626539442695807128cfd76242/users/7654579aec224c159e275c805f7dee36/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:04.429484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.450886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9322a3-c499-4d57-bb38-33e5b20d69b6 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.464617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:04.513576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8785c72-dcfc-4049-93bc-fa19fdab3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.514403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8785c72-dcfc-4049-93bc-fa19fdab3d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.514732 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8785c72-dcfc-4049-93bc-fa19fdab3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.515105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8785c72-dcfc-4049-93bc-fa19fdab3d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.515929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8785c72-dcfc-4049-93bc-fa19fdab3d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.518254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8785c72-dcfc-4049-93bc-fa19fdab3d87 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.528859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1036/2050] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:04.534401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.550539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f36a0-10b1-42db-b6f6-f026f9e494e6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.557086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.558033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.558381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.558724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] PATH_INFO: `/v3/projects/a4d8f5626539442695807128cfd76242/users/7654579aec224c159e275c805f7dee36/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.561208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d8f5626539442695807128cfd76242, user_id=7654579aec224c159e275c805f7dee36, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.563944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.575593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1015/2051] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:04 2022] PUT /identity/v3/projects/a4d8f5626539442695807128cfd76242/users/7654579aec224c159e275c805f7dee36/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:04.586757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.587081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.587371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.616008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] MFA Rules not processed for user `7654579aec224c159e275c805f7dee36`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:04.617245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:04.694357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1037/2052] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:04.702519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:04.764293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688c6a-84cd-4cc9-b3ef-104d85a1d038 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:04.769285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:04.769991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:04.770286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:04.770568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:04.784817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:04.787667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:04.802812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1016/2053] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:05.968054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:05.978337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8d563-49ff-4662-904a-edf5e609dcdd None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:05.982039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:05.982691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:05.982979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:05.983431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:06.049075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:06.051059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:06.064430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1038/2054] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:06.832879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:06.848084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701986a7-6248-4f69-8625-4b5604714b37 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:06.855473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec5cd6-f62c-4801-ac19-bea57b46bdda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:06.859604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5cd6-f62c-4801-ac19-bea57b46bdda service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:06.859604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5cd6-f62c-4801-ac19-bea57b46bdda service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:06.859604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec5cd6-f62c-4801-ac19-bea57b46bdda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:06.861478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:06.925863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:06.937390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec5cd6-f62c-4801-ac19-bea57b46bdda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:06.939678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec5cd6-f62c-4801-ac19-bea57b46bdda service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:06.949300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1017/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:06.950523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d5530-810d-4235-8183-034b23ac8cbc service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:06.956924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:06.957828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:06.958115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:06.958392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] PATH_INFO: `/v3/users/66c3cd285c75492cb6e04f894c9ac119` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:06.959655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c3cd285c75492cb6e04f894c9ac119)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:06.962057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:07.019353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c3cd285c75492cb6e04f894c9ac119'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.027723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c3cd285c75492cb6e04f894c9ac119'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.028386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c3cd285c75492cb6e04f894c9ac119'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.041953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c3cd285c75492cb6e04f894c9ac119'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.042711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c3cd285c75492cb6e04f894c9ac119'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.056457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1039/2056] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:06 2022] DELETE /identity/v3/users/66c3cd285c75492cb6e04f894c9ac119 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:07.061252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:07.061552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:07.061852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:07.080105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:07.081318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:07.086228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:07.141591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1018/2057] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:07.151393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:07.152747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:07.211009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c933d5-1b6d-43ba-9e8e-03d3bce95a36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:07.214754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:07.215439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:07.215727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:07.216010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:07.225842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:07.228539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:07.240642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1040/2058] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:07.506884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:07.508346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:07.520291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d460c-e4a0-482e-b15e-da7465890362 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:07.525200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:07.526174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:07.526359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:07.526641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] PATH_INFO: `/v3/projects/2c3e09afff93435da9d99b98628dab64` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:07.527875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3e09afff93435da9d99b98628dab64)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:07.529813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:07.577036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3e09afff93435da9d99b98628dab64', 'request_id': 'req-24041719-a2c9-4cfe-be62-1d8a64da1337'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.584196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3e09afff93435da9d99b98628dab64', 'request_id': 'req-24041719-a2c9-4cfe-be62-1d8a64da1337'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.590468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3e09afff93435da9d99b98628dab64', 'request_id': 'req-24041719-a2c9-4cfe-be62-1d8a64da1337'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.602242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] The token cache is being invalidate because project 2c3e09afff93435da9d99b98628dab64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:07.602535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.603223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.604787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1019/2059] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:07 2022] DELETE /identity/v3/projects/2c3e09afff93435da9d99b98628dab64 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:07.609165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:07.619556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe8df-f6e0-4369-9328-72033b4f88a8 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:07.677745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:07.678637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:07.678940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:07.679319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] PATH_INFO: `/v3/users/7654579aec224c159e275c805f7dee36` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:07.680485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7654579aec224c159e275c805f7dee36)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:07.682401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:07.683996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:07.730161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7654579aec224c159e275c805f7dee36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.738397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7654579aec224c159e275c805f7dee36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.739127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7654579aec224c159e275c805f7dee36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.752554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7654579aec224c159e275c805f7dee36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.753160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7654579aec224c159e275c805f7dee36'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:07.766046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1041/2060] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:07 2022] DELETE /identity/v3/users/7654579aec224c159e275c805f7dee36 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:08.139477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.141843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:08.164984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.166508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:08.180947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24041719-a2c9-4cfe-be62-1d8a64da1337 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.243084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489604a1-8f25-4d38-85e0-360dd45f767e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.245052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.245925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.246211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.246483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] PATH_INFO: `/v3/projects/a4d8f5626539442695807128cfd76242` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.247730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d8f5626539442695807128cfd76242)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.249414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.249710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.250104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.250398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.250936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.254400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:08.293277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:08.304289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d8f5626539442695807128cfd76242', 'request_id': 'req-dcd841ce-9ada-45ff-9eba-6333b59325c1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:08.321092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d8f5626539442695807128cfd76242', 'request_id': 'req-dcd841ce-9ada-45ff-9eba-6333b59325c1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:08.327967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d8f5626539442695807128cfd76242', 'request_id': 'req-dcd841ce-9ada-45ff-9eba-6333b59325c1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:08.343703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.344832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] The token cache is being invalidate because project a4d8f5626539442695807128cfd76242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:08.345260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:08.345397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c38da90-50d3-4b57-a0c1-d5fe8c8b86f9 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.346161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dcd841ce-9ada-45ff-9eba-6333b59325c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:08.350892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1020/2061] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:08 2022] DELETE /identity/v3/projects/a4d8f5626539442695807128cfd76242 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:08.352730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.353185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.353572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.356628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1042/2062] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:08.388706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:08.390209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:08.471927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1021/2063] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:08.480120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.480498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.480841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.499556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:08.500768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:08.509652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1043/2064] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:08.513723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.523988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2b1d9-ce49-4d59-aaaa-efc858cb69a1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.528959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.529619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.529905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.530180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.530903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:08.531287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.532928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.548410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1022/2065] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:19:08.549546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.559651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633fc60-3fd9-437a-bfdd-38998e1f244d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.565180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.566007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.566299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.566641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.567311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.569217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.599689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1044/2066] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:08 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:08.603955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.615280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257109cb-36a2-41a6-b9b8-d4c21d6cc9f5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.679907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.680617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.680904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.681186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.681910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.683934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.704493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1023/2067] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:08 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:08.708591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.715337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:08.719471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb63e6b-ab20-44df-b08a-cdf09c7e290b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.726623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.727425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.727793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.728204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.729077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.730890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.741793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1045/2068] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:08.745938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.757152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11471cb5-d22b-4c49-9e17-81a59f1239d2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.761979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08840ff4-bb1b-4fba-bd5a-efa825ed1e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.762620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840ff4-bb1b-4fba-bd5a-efa825ed1e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.762913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840ff4-bb1b-4fba-bd5a-efa825ed1e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.763275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840ff4-bb1b-4fba-bd5a-efa825ed1e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.764006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08840ff4-bb1b-4fba-bd5a-efa825ed1e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.767001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08840ff4-bb1b-4fba-bd5a-efa825ed1e61 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.779580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1024/2069] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:08.783681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:08.796787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0b1b-9d79-41ce-ba6c-95ef4fe3bcb2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:08.802318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:08.803473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.803788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.804075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] PATH_INFO: `/v3/projects/a3f6013f42354a6f8aedc95a22640c6f/users/2e1686469b1c4971b0f2f7069806752f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.824195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f6013f42354a6f8aedc95a22640c6f, user_id=2e1686469b1c4971b0f2f7069806752f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:08.827831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:08.851891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1046/2070] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:08 2022] PUT /identity/v3/projects/a3f6013f42354a6f8aedc95a22640c6f/users/2e1686469b1c4971b0f2f7069806752f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:08.855256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:08.855563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:08.855854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:08.889067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] MFA Rules not processed for user `2e1686469b1c4971b0f2f7069806752f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:08.890403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:08.912800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:08.982806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1025/2071] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:08.987999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.134803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad2fe-a38a-4117-8e06-26f3c9650f5d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.164728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.165489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.166061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.166156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.166919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.171721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.241076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1047/2072] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:08 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:09.245747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.260394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a28f80-2cbe-439f-a611-f75b5c0965b8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.337100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.337781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.338071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.338354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.339087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.341014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.361393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1026/2073] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:09 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:09.365338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.375642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759e894-de2a-4e62-81f5-3ee5f62a126c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.380426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.381085 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.381377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.381658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.382402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.384028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.398642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1048/2074] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:09.400125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.411302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117cc3c-f9bf-40a1-923b-ac911702b725 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.416472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.417369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.417662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.417940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] PATH_INFO: `/v3/projects/69057d70be7b47a3bd2ae172d939d2eb/users/5eac3ed280f94375804cf7ea75ee6c91/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.435245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69057d70be7b47a3bd2ae172d939d2eb, user_id=5eac3ed280f94375804cf7ea75ee6c91, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.437928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.451709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1027/2075] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:09 2022] PUT /identity/v3/projects/69057d70be7b47a3bd2ae172d939d2eb/users/5eac3ed280f94375804cf7ea75ee6c91/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:09.457189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.469550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d5a80-0069-4423-b386-968b0944c22f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.533499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975bf99-70ef-484b-a837-b6b67e6b9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.534183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975bf99-70ef-484b-a837-b6b67e6b9f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.534506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975bf99-70ef-484b-a837-b6b67e6b9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.534902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975bf99-70ef-484b-a837-b6b67e6b9f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.535679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975bf99-70ef-484b-a837-b6b67e6b9f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.537267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975bf99-70ef-484b-a837-b6b67e6b9f0e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.550273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1049/2076] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:09.551443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.564939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d30e87-484d-479e-b12f-634f8d719e17 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.570104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.571122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.571470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.571813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] PATH_INFO: `/v3/projects/69057d70be7b47a3bd2ae172d939d2eb/users/5eac3ed280f94375804cf7ea75ee6c91/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.573874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69057d70be7b47a3bd2ae172d939d2eb, user_id=5eac3ed280f94375804cf7ea75ee6c91, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.576690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.588786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1028/2077] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:09 2022] PUT /identity/v3/projects/69057d70be7b47a3bd2ae172d939d2eb/users/5eac3ed280f94375804cf7ea75ee6c91/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:09.598800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.599147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.599437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.629378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] MFA Rules not processed for user `5eac3ed280f94375804cf7ea75ee6c91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:09.630646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:09.662079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:09.713494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1050/2078] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:09.725726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.729363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:09.805515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899459-b314-4ae7-89e6-d970f6ab09d0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.809143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff7dc3-2afa-409c-b641-38cfed7d986e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.810044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7dc3-2afa-409c-b641-38cfed7d986e service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.810327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7dc3-2afa-409c-b641-38cfed7d986e service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.810603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff7dc3-2afa-409c-b641-38cfed7d986e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:09.820271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff7dc3-2afa-409c-b641-38cfed7d986e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:09.821701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff7dc3-2afa-409c-b641-38cfed7d986e service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:09.832875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1029/2079] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:09.931297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:09.940909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5df98a-ac13-417f-b85e-854c4aea1887 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:09.944562 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:09.945209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:09.945496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:09.945776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:10.004498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:10.005947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:10.016402 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1051/2080] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:10.216709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:10.216997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:10.217423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:10.240679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] MFA Rules not processed for user `fbe4191263234dfa9a035dca48d22cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:10.241871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:10.251681 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:10.307184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1030/2081] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:10.765180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:10.767802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:10.848768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8d6b1-ea8d-4727-9f51-dfb545a0ec45 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:10.854467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:10.855458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:10.855750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:10.856024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] PATH_INFO: `/v3/users/8c35c326c5e3488eb406aab41bd433a5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:10.857374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c35c326c5e3488eb406aab41bd433a5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:10.859544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:10.877469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:10.878903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:10.907602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49da41-25cd-4ee7-bd45-49d0e4f634e9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:10.920115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:10.920996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:10.921277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:10.921599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] PATH_INFO: `/v3/users/9d3b868d98c34daf9b05e3a6302abba4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:10.923678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3b868d98c34daf9b05e3a6302abba4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:10.925524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:10.934704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c35c326c5e3488eb406aab41bd433a5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:10.949102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c35c326c5e3488eb406aab41bd433a5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:10.949905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c35c326c5e3488eb406aab41bd433a5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:10.964529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:10.973505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c35c326c5e3488eb406aab41bd433a5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:10.974477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a6bb9407-cf3c-4317-bddd-5526cacde159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c35c326c5e3488eb406aab41bd433a5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:10.995445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1052/2082] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:10 2022] DELETE /identity/v3/users/8c35c326c5e3488eb406aab41bd433a5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:11.000148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.000684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.001817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.013308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3b868d98c34daf9b05e3a6302abba4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.022807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:11.024505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.028774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3b868d98c34daf9b05e3a6302abba4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.057934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3b868d98c34daf9b05e3a6302abba4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.061202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3b868d98c34daf9b05e3a6302abba4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.071161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f71b9bca-438b-4cd9-8aa8-182fc79a08a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3b868d98c34daf9b05e3a6302abba4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.077699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1031/2083] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:10 2022] DELETE /identity/v3/users/9d3b868d98c34daf9b05e3a6302abba4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:11.082347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.082703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.083067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.102140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:11.103436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.110155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1053/2084] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:11.120541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:11.122129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.177893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1032/2085] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:11.189710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:11.190644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ac92f-0ed2-4a0d-8511-6ebe8a5d2779 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:11.228024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:11.245890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:11.246558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.246852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.247164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.253190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ca3b2-df01-4e8b-83fe-4f317a11ac15 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:11.258491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:11.258636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:11.259460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.259760 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.260100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:11.260369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.271113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1054/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:11.271245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:11.272772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:11.285055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1033/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:11.723534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:11.725495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.742385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b022e9f-5501-4b90-ad01-5c2f4f0bb488 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:11.748285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43440366-303d-4484-85db-7902380692fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:11.749430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43440366-303d-4484-85db-7902380692fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.749764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43440366-303d-4484-85db-7902380692fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.752739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43440366-303d-4484-85db-7902380692fc admin admin] PATH_INFO: `/v3/projects/66e38c079cef4121bb77077dc68ad860` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.753587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43440366-303d-4484-85db-7902380692fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e38c079cef4121bb77077dc68ad860)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:11.753771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:11.755476 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.755592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43440366-303d-4484-85db-7902380692fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:11.770016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bff9-cc18-4afb-8388-e379b7f014ba service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:11.775078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:11.776225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.776518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.776803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] PATH_INFO: `/v3/projects/e6b76bb8784a453d898b0751f0a3086a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.778026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b76bb8784a453d898b0751f0a3086a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:11.780025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:11.821241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:11.833488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43440366-303d-4484-85db-7902380692fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e38c079cef4121bb77077dc68ad860', 'request_id': 'req-43440366-303d-4484-85db-7902380692fc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.842337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43440366-303d-4484-85db-7902380692fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e38c079cef4121bb77077dc68ad860', 'request_id': 'req-43440366-303d-4484-85db-7902380692fc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.849960 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b76bb8784a453d898b0751f0a3086a', 'request_id': 'req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.850143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43440366-303d-4484-85db-7902380692fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e38c079cef4121bb77077dc68ad860', 'request_id': 'req-43440366-303d-4484-85db-7902380692fc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.857605 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b76bb8784a453d898b0751f0a3086a', 'request_id': 'req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.862244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43440366-303d-4484-85db-7902380692fc admin admin] The token cache is being invalidate because project 66e38c079cef4121bb77077dc68ad860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:11.862619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43440366-303d-4484-85db-7902380692fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.863351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-43440366-303d-4484-85db-7902380692fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.864981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1055/2088] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:11 2022] DELETE /identity/v3/projects/66e38c079cef4121bb77077dc68ad860 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:11.865303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b76bb8784a453d898b0751f0a3086a', 'request_id': 'req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.869443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43440366-303d-4484-85db-7902380692fc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:11.871130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-43440366-303d-4484-85db-7902380692fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.876222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] The token cache is being invalidate because project e6b76bb8784a453d898b0751f0a3086a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:11.876553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.877203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:11.878762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1034/2089] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:11 2022] DELETE /identity/v3/projects/e6b76bb8784a453d898b0751f0a3086a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:11.883329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:11.884833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:11.939276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43440366-303d-4484-85db-7902380692fc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:11.944170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:11.945052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.945339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.945622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] PATH_INFO: `/v3/users/1e4e678093144c48b9c569b7444d4548` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.946936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4e678093144c48b9c569b7444d4548)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:11.949001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:11.949704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb28fe-7382-4ef1-a13e-aa3ead8a2e38 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:11.955026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:11.955939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:11.956225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:11.956498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] PATH_INFO: `/v3/users/1c3713e6f98a4dec853eee6433b3dd2b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:11.957728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3713e6f98a4dec853eee6433b3dd2b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:11.960601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:12.009370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4e678093144c48b9c569b7444d4548'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.016637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3713e6f98a4dec853eee6433b3dd2b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.020313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4e678093144c48b9c569b7444d4548'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.021071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4e678093144c48b9c569b7444d4548'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.025088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3713e6f98a4dec853eee6433b3dd2b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.031568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:12.036823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4e678093144c48b9c569b7444d4548'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.037595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4e678093144c48b9c569b7444d4548'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.044129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3713e6f98a4dec853eee6433b3dd2b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.045361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3713e6f98a4dec853eee6433b3dd2b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.052314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1056/2090] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:11 2022] DELETE /identity/v3/users/1e4e678093144c48b9c569b7444d4548 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:12.056459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3713e6f98a4dec853eee6433b3dd2b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.063275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1035/2091] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:11 2022] DELETE /identity/v3/users/1c3713e6f98a4dec853eee6433b3dd2b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:12.584303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:12.585938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:12.639724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:12.662632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5ceb8-5568-4bfd-96c0-b30ae8058d8e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:12.690174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:12.691734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:12.727656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:12.728537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:12.728828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:12.729112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] PATH_INFO: `/v3/projects/bce135d550e1478db1d678dbbcc46ada` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:12.730320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce135d550e1478db1d678dbbcc46ada)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:12.732284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:12.774822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bb385-ccd0-49a1-b4ed-3e731ba1db40 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:12.782014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:12.784121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:12.784460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:12.784832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] PATH_INFO: `/v3/users/2e1686469b1c4971b0f2f7069806752f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:12.787297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1686469b1c4971b0f2f7069806752f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:12.789474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:12.813356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce135d550e1478db1d678dbbcc46ada', 'request_id': 'req-1e165e7c-0370-41b2-b7ff-809bd76d2306'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.822689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce135d550e1478db1d678dbbcc46ada', 'request_id': 'req-1e165e7c-0370-41b2-b7ff-809bd76d2306'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.831591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce135d550e1478db1d678dbbcc46ada', 'request_id': 'req-1e165e7c-0370-41b2-b7ff-809bd76d2306'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.847809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] The token cache is being invalidate because project bce135d550e1478db1d678dbbcc46ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:12.848295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.848971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.853834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1057/2092] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:12 2022] DELETE /identity/v3/projects/bce135d550e1478db1d678dbbcc46ada => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:12.854800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:12.856427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:12.886600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1686469b1c4971b0f2f7069806752f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.899702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1686469b1c4971b0f2f7069806752f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.917272 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1686469b1c4971b0f2f7069806752f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.918107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1686469b1c4971b0f2f7069806752f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.927265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1686469b1c4971b0f2f7069806752f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:12.938662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1036/2093] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:12 2022] DELETE /identity/v3/users/2e1686469b1c4971b0f2f7069806752f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:12.939889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:12.941621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:12.965070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e165e7c-0370-41b2-b7ff-809bd76d2306 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:13.006138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:13.036233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:13.040782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee20478-1892-4f78-b03b-d400e2b59c75 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:13.047065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:13.048701 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.049144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.049428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] PATH_INFO: `/v3/projects/74f27bb3abeb4a7091e9be7cfa42e557` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.050266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:13.050636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f27bb3abeb4a7091e9be7cfa42e557)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:13.051606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.052052 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.052557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] PATH_INFO: `/v3/users/d928f67681794e5d82191ac44fe3e92f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.052670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:13.054031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d928f67681794e5d82191ac44fe3e92f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:13.058325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:13.108045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f27bb3abeb4a7091e9be7cfa42e557', 'request_id': 'req-3ab0dd64-1d40-4d95-a43d-8064dffc010f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.118519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f27bb3abeb4a7091e9be7cfa42e557', 'request_id': 'req-3ab0dd64-1d40-4d95-a43d-8064dffc010f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.121705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd928f67681794e5d82191ac44fe3e92f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.129864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f27bb3abeb4a7091e9be7cfa42e557', 'request_id': 'req-3ab0dd64-1d40-4d95-a43d-8064dffc010f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.130621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd928f67681794e5d82191ac44fe3e92f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.144220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] The token cache is being invalidate because project 74f27bb3abeb4a7091e9be7cfa42e557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:13.144730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.145487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3ab0dd64-1d40-4d95-a43d-8064dffc010f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.145907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd928f67681794e5d82191ac44fe3e92f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.146667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd928f67681794e5d82191ac44fe3e92f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.147385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1058/2094] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:12 2022] DELETE /identity/v3/projects/74f27bb3abeb4a7091e9be7cfa42e557 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:13.148746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.149106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.149641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.156397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd928f67681794e5d82191ac44fe3e92f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.165554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1037/2095] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:12 2022] DELETE /identity/v3/users/d928f67681794e5d82191ac44fe3e92f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:13.166520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:13.170871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.175745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:13.176959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.274138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1059/2096] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:13.285166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9465c-7115-4fb5-be5e-23d2cf0de9c5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:13.290239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:13.291184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.293058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.293058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] PATH_INFO: `/v3/users/c868916b147a406582a5c965dca9a261` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.293990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c868916b147a406582a5c965dca9a261)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:13.294717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:13.296097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:13.297563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.365233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c868916b147a406582a5c965dca9a261'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.381754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c868916b147a406582a5c965dca9a261'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.409414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c868916b147a406582a5c965dca9a261'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.410929 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c868916b147a406582a5c965dca9a261'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.421155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5671-9752-4023-ba2f-01c9818e0b7b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:13.423117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:13.427029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c868916b147a406582a5c965dca9a261'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.431210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:13.433634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.433978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.435064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.440465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.447061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1038/2097] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:13 2022] DELETE /identity/v3/users/c868916b147a406582a5c965dca9a261 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:13.467753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:13.469307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af9dbd-9922-49f5-83c8-b6b9eb431813 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:13.481396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1060/2098] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:13.553096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:13.554872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.654972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539477-3435-4857-84c8-43e1b397f77b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:13.659966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:13.660857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.661148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.661429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] PATH_INFO: `/v3/projects/adab8621e7ce4ec7af80c390216ff2e4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.662660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] RBAC: Authorizing `identity:delete_project(project_id=adab8621e7ce4ec7af80c390216ff2e4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:13.664735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:13.743295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adab8621e7ce4ec7af80c390216ff2e4', 'request_id': 'req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.754400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adab8621e7ce4ec7af80c390216ff2e4', 'request_id': 'req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.763432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adab8621e7ce4ec7af80c390216ff2e4', 'request_id': 'req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.777607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] The token cache is being invalidate because project adab8621e7ce4ec7af80c390216ff2e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:13.778455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.779443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:13.785879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1039/2099] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:13 2022] DELETE /identity/v3/projects/adab8621e7ce4ec7af80c390216ff2e4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:13.788666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f5624-7f73-426c-920a-a5c448cd437a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.789004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f5624-7f73-426c-920a-a5c448cd437a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.789309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f5624-7f73-426c-920a-a5c448cd437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.796551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:13.813147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6a2f5624-7f73-426c-920a-a5c448cd437a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:13.816138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6a2f5624-7f73-426c-920a-a5c448cd437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.882456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:13.884607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.913109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1061/2100] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:13.920946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.922234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.922234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.941257 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:13.942585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:13.954210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1062/2101] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:13.958669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:13.968554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148011b-aed2-40b1-b121-51b24125fdb5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:13.975555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:13.976098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:13.976397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:13.976685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:13.977469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:13.977786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:13.979707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:13.997941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1063/2102] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:19:13.999703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.007753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c1b87-3ec4-4ba6-b81d-08ad75cd764d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.014598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f5830-a05d-4074-ada2-f08e8eac27eb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.020478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.021312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.022174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.022521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.022814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.023853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.027331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.027473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.027557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.027817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] PATH_INFO: `/v3/projects/a3f6013f42354a6f8aedc95a22640c6f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.029221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f6013f42354a6f8aedc95a22640c6f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.031375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.097229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:14.097377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1064/2103] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:13 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:14.098447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.100388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.122392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f6013f42354a6f8aedc95a22640c6f', 'request_id': 'req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.135025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f6013f42354a6f8aedc95a22640c6f', 'request_id': 'req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.146522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f6013f42354a6f8aedc95a22640c6f', 'request_id': 'req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.166221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] The token cache is being invalidate because project a3f6013f42354a6f8aedc95a22640c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:14.166516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.167349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.169111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1040/2104] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:13 2022] DELETE /identity/v3/projects/a3f6013f42354a6f8aedc95a22640c6f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:14.169643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.172218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.200077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a11c4-184a-4a5b-a0c5-a5a4fdabc864 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.265154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7cf188-d6b0-4d1a-8cb1-defa0136b0e6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.273781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.274174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.274465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.274746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.275460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.277397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.280272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.281247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.281602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.281949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] PATH_INFO: `/v3/projects/b52100575829464d84b02e3e16ffc5cf` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.283503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52100575829464d84b02e3e16ffc5cf)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.285676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.297551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:14.299552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1041/2105] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:14.303637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.305389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.320298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fad77-bace-4a77-b0aa-58665fe9ddb5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.326017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.327398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.327803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.328086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] PATH_INFO: `/v3/users/5eac3ed280f94375804cf7ea75ee6c91` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.329357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eac3ed280f94375804cf7ea75ee6c91)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.331842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.352095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52100575829464d84b02e3e16ffc5cf', 'request_id': 'req-b1984264-b4fc-44b0-ad82-4770b3143e9a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.364263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52100575829464d84b02e3e16ffc5cf', 'request_id': 'req-b1984264-b4fc-44b0-ad82-4770b3143e9a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.379005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52100575829464d84b02e3e16ffc5cf', 'request_id': 'req-b1984264-b4fc-44b0-ad82-4770b3143e9a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.398206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] The token cache is being invalidate because project b52100575829464d84b02e3e16ffc5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:14.398206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.398475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.399971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1065/2106] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:14 2022] DELETE /identity/v3/projects/b52100575829464d84b02e3e16ffc5cf => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:14.400728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.402018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.405190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eac3ed280f94375804cf7ea75ee6c91'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.416714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eac3ed280f94375804cf7ea75ee6c91'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.434758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eac3ed280f94375804cf7ea75ee6c91'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.435578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eac3ed280f94375804cf7ea75ee6c91'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.448745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-af7ac6fe-de74-4ba0-8401-55bfb9cae657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eac3ed280f94375804cf7ea75ee6c91'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:14.457116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1042/2107] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:14 2022] DELETE /identity/v3/users/5eac3ed280f94375804cf7ea75ee6c91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:14.459351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10fe23-9fba-46ae-a48e-8bdc840c7719 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.459351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10fe23-9fba-46ae-a48e-8bdc840c7719 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.459351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10fe23-9fba-46ae-a48e-8bdc840c7719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.478328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984264-b4fc-44b0-ad82-4770b3143e9a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.506174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ca10fe23-9fba-46ae-a48e-8bdc840c7719 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:14.507451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ca10fe23-9fba-46ae-a48e-8bdc840c7719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.534624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=80,keystone:DELETE=15,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:14.574335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.575003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.575326 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.575607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.576928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.578950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.590323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1066/2108] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:14.594319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.596075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.609706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381d0f3-dd3a-4f82-a5f6-9ba6a700d7d9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.617386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1043/2109] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:14.618282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.619475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.619841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.620198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.621015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.623050 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.625154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.625452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.625735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.642490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1067/2110] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:14.647010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.655988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:14.657213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.658272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe3862-4cdf-43dd-b3a4-1fdf3eebf93e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.663765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86454463-b2b5-4a5c-8089-7c2c1402affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.665025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86454463-b2b5-4a5c-8089-7c2c1402affc admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.665139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86454463-b2b5-4a5c-8089-7c2c1402affc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.665408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86454463-b2b5-4a5c-8089-7c2c1402affc admin admin] PATH_INFO: `/v3/projects/4bea2c6c4f0347e09969d897dcd742f6/users/4bb96496a5c34b3b86ea78d241630d74/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.666152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1044/2111] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:14.670287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.689328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358afb7-b21a-49f6-8ffc-f745c79d4aff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.691075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86454463-b2b5-4a5c-8089-7c2c1402affc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bea2c6c4f0347e09969d897dcd742f6, user_id=4bb96496a5c34b3b86ea78d241630d74, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.693838 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86454463-b2b5-4a5c-8089-7c2c1402affc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.697976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.699033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.699561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.700429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.700840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:14.701351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.703373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.718216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1045/2112] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:19:14.719783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1068/2113] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:14 2022] PUT /identity/v3/projects/4bea2c6c4f0347e09969d897dcd742f6/users/4bb96496a5c34b3b86ea78d241630d74/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:14.724560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.731486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.731782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.732072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.746231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:14.763585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feaee9-be41-4725-8192-9ce81cf5fd04 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.776599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] MFA Rules not processed for user `4bb96496a5c34b3b86ea78d241630d74`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:14.777841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.839854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.840519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.840803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.841202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.842063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.844174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.887210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1046/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:14.887210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.889977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:14.894176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1069/2115] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:14.895063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:14.905908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b1e4d-759a-4859-a312-92ce5f16cca3 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.966489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.967198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.967476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.967756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.968462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.970388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.976932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9362e78-c2fd-4ea7-af8c-9ea20950ac0a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:14.981882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:14.983338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:14.983672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:14.984153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] PATH_INFO: `/v3/projects/69057d70be7b47a3bd2ae172d939d2eb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:14.986631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] RBAC: Authorizing `identity:delete_project(project_id=69057d70be7b47a3bd2ae172d939d2eb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:14.989092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:14.993213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1070/2116] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:14.994150 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.006516 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05160fb4-4359-409f-b580-fa3457f139e4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.011390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.012041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.012327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.012603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.013341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.015259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.026893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:15.044643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1071/2117] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:14 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:15.045471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.045685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69057d70be7b47a3bd2ae172d939d2eb', 'request_id': 'req-e5841efb-a998-4f44-926a-37ca561ba36b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:15.053653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69057d70be7b47a3bd2ae172d939d2eb', 'request_id': 'req-e5841efb-a998-4f44-926a-37ca561ba36b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:15.060356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69057d70be7b47a3bd2ae172d939d2eb', 'request_id': 'req-e5841efb-a998-4f44-926a-37ca561ba36b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:15.072031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] The token cache is being invalidate because project 69057d70be7b47a3bd2ae172d939d2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:15.072031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:15.073670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:15.075323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1047/2118] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:14 2022] DELETE /identity/v3/projects/69057d70be7b47a3bd2ae172d939d2eb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:15.076115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.077782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.113311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bff835-31de-4a6b-9d7e-9666451f5cfe admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.118320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea7e22-2504-46c8-8ad8-724dbaf7f90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.118992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea7e22-2504-46c8-8ad8-724dbaf7f90d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.119310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea7e22-2504-46c8-8ad8-724dbaf7f90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.119589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea7e22-2504-46c8-8ad8-724dbaf7f90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.120315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea7e22-2504-46c8-8ad8-724dbaf7f90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.121905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea7e22-2504-46c8-8ad8-724dbaf7f90d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.127100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:15.135258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1072/2119] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:15.136500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.136790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.137070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.142562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5841efb-a998-4f44-926a-37ca561ba36b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.147416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ef3c3-774b-4002-b9c6-787a6bf2d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.148085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ef3c3-774b-4002-b9c6-787a6bf2d0be admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.148372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ef3c3-774b-4002-b9c6-787a6bf2d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.148654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ef3c3-774b-4002-b9c6-787a6bf2d0be admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.149342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ef3c3-774b-4002-b9c6-787a6bf2d0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.151321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ef3c3-774b-4002-b9c6-787a6bf2d0be admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.155670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:15.156828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.165477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1073/2120] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:15.166031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.167244 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.179075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1048/2121] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:15.179520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395c19d-bfdd-4fd1-8015-748c66127092 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.180334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.180628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.180908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.185197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.185952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.186239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.186519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.187291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.188992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.202121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1074/2122] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:15.202305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:15.202425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.202530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.209802 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1049/2123] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:15.210565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.211484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fa7a9-bbab-483d-945d-20ec9a2377f4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.216553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.217242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.217546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.217828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.218551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.219669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eec05-3035-4b92-8c69-0fbcc55e710d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.220681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.224762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.225613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.225892 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.226160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] PATH_INFO: `/v3/projects/2bc2ba2f80a0415fb612ae2a17b0c0ae/users/7cba6211fafb4d6885c130eb889b5c07/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.230786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1075/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:15.231911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.242219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc2ba2f80a0415fb612ae2a17b0c0ae, user_id=7cba6211fafb4d6885c130eb889b5c07, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.243625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2339f8-0e8e-4eee-a640-5fa603280d36 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.245028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.248230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.248870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.249160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.249442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.250181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:15.250470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.259817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb7fc5-eacd-4163-bb6e-58eab7bfc0a5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.268515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1050/2125] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:15 2022] PUT /identity/v3/projects/2bc2ba2f80a0415fb612ae2a17b0c0ae/users/7cba6211fafb4d6885c130eb889b5c07/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:15.268515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.274698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1076/2126] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:19:15.276165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.276463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.276745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.305938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] MFA Rules not processed for user `7cba6211fafb4d6885c130eb889b5c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:15.307179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.343166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146c05f-d233-440b-a346-377d4862d9cf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.354106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.355397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.355758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.356039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] PATH_INFO: `/v3/projects/a1e7bee8c5d54e3bb2f9f596e7951441/users/95a9584b882f4c7cbb8a86a0d951940f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.374051 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e7bee8c5d54e3bb2f9f596e7951441, user_id=95a9584b882f4c7cbb8a86a0d951940f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.376792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.383484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1077/2127] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:15.383484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.385397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:15.395135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46735f5-41e8-44f3-be23-c50a1ba6e5fe None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.401663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1051/2128] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:15 2022] PUT /identity/v3/projects/a1e7bee8c5d54e3bb2f9f596e7951441/users/95a9584b882f4c7cbb8a86a0d951940f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:15.405484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.408748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.460984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.461736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.462095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.462445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.463243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.465237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.473726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c30189-cb85-4358-8c7e-7cad1bb7e466 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.477532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.478172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.478459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.478733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.490890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1078/2129] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:15.492032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.528661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:15.542996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.544485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.553987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1052/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:15.554746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.559867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba65cc4-bf8b-45e0-af28-5690dd8ec55a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.565365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.566140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.566432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.566715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.566835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2bd4-6acb-474f-8148-30b60b4dd451 service glance] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.567476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.569192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.571861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.572520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.572807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.573089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.574016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.575830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.587082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1079/2131] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:15.588088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.602452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1053/2132] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:15.602643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3350894-49a9-48fc-9b76-e805a81e968f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.604411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.605308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718127c-5063-47aa-9c6a-2bb0c58501d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.606201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718127c-5063-47aa-9c6a-2bb0c58501d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.606491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718127c-5063-47aa-9c6a-2bb0c58501d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.606775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718127c-5063-47aa-9c6a-2bb0c58501d0 admin admin] PATH_INFO: `/v3/projects/a1e7bee8c5d54e3bb2f9f596e7951441/users/95a9584b882f4c7cbb8a86a0d951940f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.608815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718127c-5063-47aa-9c6a-2bb0c58501d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e7bee8c5d54e3bb2f9f596e7951441, user_id=95a9584b882f4c7cbb8a86a0d951940f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.612619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718127c-5063-47aa-9c6a-2bb0c58501d0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.617564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d08ec-8660-4caa-ac61-dc24e218f13c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.624625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1080/2133] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:15 2022] PUT /identity/v3/projects/a1e7bee8c5d54e3bb2f9f596e7951441/users/95a9584b882f4c7cbb8a86a0d951940f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:15.635975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.636302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.636565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.665568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] MFA Rules not processed for user `95a9584b882f4c7cbb8a86a0d951940f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:15.666764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.686643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.687501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.687660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.687927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.688708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.690829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.701255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1054/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:15.705317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.715966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74617545-3d94-435c-a495-b6f9599990d6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.721364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.722426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.722716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.722998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.723772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.725343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.737787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1055/2135] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:15.742201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.747248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1081/2136] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:15.753533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6912d4-a39e-4e41-8a31-674961560e0d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.759259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e43fa-78f1-4363-aed2-556b9e564e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.760164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e43fa-78f1-4363-aed2-556b9e564e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.760682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e43fa-78f1-4363-aed2-556b9e564e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.760682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e43fa-78f1-4363-aed2-556b9e564e7d admin admin] PATH_INFO: `/v3/projects/cde93914807e4f298deed33b55a411df/users/0d97edb848c54d8da23c57f93c3d6597/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.764663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:15.766853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.778910 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e43fa-78f1-4363-aed2-556b9e564e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde93914807e4f298deed33b55a411df, user_id=0d97edb848c54d8da23c57f93c3d6597, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:15.781623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e43fa-78f1-4363-aed2-556b9e564e7d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:15.785185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:15.800813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1056/2137] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:15 2022] PUT /identity/v3/projects/cde93914807e4f298deed33b55a411df/users/0d97edb848c54d8da23c57f93c3d6597/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:15.812743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883abed6-1541-47c2-8b30-55860298afcf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.813121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883abed6-1541-47c2-8b30-55860298afcf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.813959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883abed6-1541-47c2-8b30-55860298afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.847444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-883abed6-1541-47c2-8b30-55860298afcf None None] MFA Rules not processed for user `0d97edb848c54d8da23c57f93c3d6597`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:15.848869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-883abed6-1541-47c2-8b30-55860298afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:15.861800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a45f87-946c-46f6-b561-7e4ecc5d5002 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:15.922291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:15.923651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:15.923897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:15.924184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:15.936281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1057/2138] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:15.938149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:16.010093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883abed6-1541-47c2-8b30-55860298afcf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:16.010691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.011648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-883abed6-1541-47c2-8b30-55860298afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.014777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.024555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883abed6-1541-47c2-8b30-55860298afcf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:16.027694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1082/2139] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:16.028509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896796c-00ec-4bcc-ac86-a16a35721655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:16.029154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896796c-00ec-4bcc-ac86-a16a35721655 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.029439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896796c-00ec-4bcc-ac86-a16a35721655 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.029713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896796c-00ec-4bcc-ac86-a16a35721655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.040088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896796c-00ec-4bcc-ac86-a16a35721655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.041829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896796c-00ec-4bcc-ac86-a16a35721655 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.055359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1058/2140] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:16.077205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:16.190899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba1dab-3093-45f2-804a-7a99d1961873 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:16.195855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:16.196804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.197087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.197368 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] PATH_INFO: `/v3/users/0d97edb848c54d8da23c57f93c3d6597` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.200800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d97edb848c54d8da23c57f93c3d6597)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.202863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.267574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d97edb848c54d8da23c57f93c3d6597'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.278374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d97edb848c54d8da23c57f93c3d6597'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.279063 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d97edb848c54d8da23c57f93c3d6597'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.294224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d97edb848c54d8da23c57f93c3d6597'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.294911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d97edb848c54d8da23c57f93c3d6597'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.310670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1083/2141] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:16 2022] DELETE /identity/v3/users/0d97edb848c54d8da23c57f93c3d6597 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:16.314871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.315200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.315479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.333876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:16.338538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.406403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1059/2142] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:16.416276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:16.417805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.452961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:16.492816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:16.492955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbfcc5-c52f-45ed-9dd6-e72fc0a0ab9e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:16.494224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.496667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83cdd7-a886-4268-bec9-cba672ab9cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:16.497324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83cdd7-a886-4268-bec9-cba672ab9cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.497613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83cdd7-a886-4268-bec9-cba672ab9cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.497894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83cdd7-a886-4268-bec9-cba672ab9cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.506817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c25fc6-ce93-405c-b61a-0fc9b7308092 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:16.510206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83cdd7-a886-4268-bec9-cba672ab9cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.511762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83cdd7-a886-4268-bec9-cba672ab9cc5 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.512544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:16.513569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.513857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.514370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] PATH_INFO: `/v3/users/4bb96496a5c34b3b86ea78d241630d74` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.515438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb96496a5c34b3b86ea78d241630d74)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.517993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.531488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1084/2143] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:16.600587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb96496a5c34b3b86ea78d241630d74'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.613332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb96496a5c34b3b86ea78d241630d74'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.633810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:16.644731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb96496a5c34b3b86ea78d241630d74'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.645539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb96496a5c34b3b86ea78d241630d74'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.658275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb96496a5c34b3b86ea78d241630d74'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.668615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1060/2144] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:16 2022] DELETE /identity/v3/users/4bb96496a5c34b3b86ea78d241630d74 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:16.670412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.670704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.671004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.689993 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:16.691172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.759711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1085/2145] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:16.769820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:16.771323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.836655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1449a-d0f8-4bfb-bb28-aa98a0138bbb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:16.840744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31461918-c711-42a1-b94a-97a921c4560e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:16.841477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31461918-c711-42a1-b94a-97a921c4560e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.841839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31461918-c711-42a1-b94a-97a921c4560e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.842197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31461918-c711-42a1-b94a-97a921c4560e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.843750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:16.845361 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:16.853569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31461918-c711-42a1-b94a-97a921c4560e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.855030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31461918-c711-42a1-b94a-97a921c4560e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.857855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c492-7bec-45b4-9b81-f591968583ed None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:16.863671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:16.867196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.867196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.867196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] PATH_INFO: `/v3/projects/cde93914807e4f298deed33b55a411df` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.870647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde93914807e4f298deed33b55a411df)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:16.872709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:16.873088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1061/2146] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:16.922286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde93914807e4f298deed33b55a411df', 'request_id': 'req-5184ce17-0f17-4916-888f-d5fa721a80af'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.935844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde93914807e4f298deed33b55a411df', 'request_id': 'req-5184ce17-0f17-4916-888f-d5fa721a80af'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.945526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde93914807e4f298deed33b55a411df', 'request_id': 'req-5184ce17-0f17-4916-888f-d5fa721a80af'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.957564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] The token cache is being invalidate because project cde93914807e4f298deed33b55a411df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:16.957857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.958565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5184ce17-0f17-4916-888f-d5fa721a80af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:16.960389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1086/2147] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:16 2022] DELETE /identity/v3/projects/cde93914807e4f298deed33b55a411df => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:16.965460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:16.965758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:16.966045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:16.987465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:16.987645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.065602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1062/2148] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:17.075958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.076942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.077661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.104346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:17.105725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.119795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1087/2149] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:17.124001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.135299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7227a-0451-4970-83b9-b8728b8cd759 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.141183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.142097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.142389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.142736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.143714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:17.144095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.146320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.164867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1063/2150] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:19:17.169165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.180126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8e0f4-4ca0-4272-aaf0-0422996f2928 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.185687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.186335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.186625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.186908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.187764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.190175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.193053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.195017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.209593 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621fe50-852d-45cd-a3d4-448c52a6a6dd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.216669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.217689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.217977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.218351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] PATH_INFO: `/v3/projects/4bea2c6c4f0347e09969d897dcd742f6` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.221497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bea2c6c4f0347e09969d897dcd742f6)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.224443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.244513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1088/2151] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:17 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:17.245610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.281688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:17.287352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bea2c6c4f0347e09969d897dcd742f6', 'request_id': 'req-add56c55-d051-4958-8b32-5a185742cca2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.299776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bea2c6c4f0347e09969d897dcd742f6', 'request_id': 'req-add56c55-d051-4958-8b32-5a185742cca2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.307458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bea2c6c4f0347e09969d897dcd742f6', 'request_id': 'req-add56c55-d051-4958-8b32-5a185742cca2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.312408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:17.320358 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] The token cache is being invalidate because project 4bea2c6c4f0347e09969d897dcd742f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:17.320995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.321895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.322958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962802f5-43b9-47d2-a4d9-a7858a7748a9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.323806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1064/2152] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:17 2022] DELETE /identity/v3/projects/4bea2c6c4f0347e09969d897dcd742f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:17.327589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.328900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.383693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.384392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.384684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.384974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.385690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.387670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.416115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1089/2153] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:17 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:17.417696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.418890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add56c55-d051-4958-8b32-5a185742cca2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.419786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.426109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.427242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.427529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.427811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] PATH_INFO: `/v3/users/95a9584b882f4c7cbb8a86a0d951940f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.429552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a9584b882f4c7cbb8a86a0d951940f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.433116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.437164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792920-dc69-4358-9f8e-e123511cd1c2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.444002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.444705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.444992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.445272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.446017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.447671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.458539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1090/2154] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:17.462198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.474388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f198204-67f4-4902-a330-35fde611f49d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.484386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.486116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.487669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.487669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.488531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.490475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.497580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a9584b882f4c7cbb8a86a0d951940f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.507084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1091/2155] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:17.509924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.510065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a9584b882f4c7cbb8a86a0d951940f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.521469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5170ec-07a5-4051-b61a-bdaf3f798f98 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.537621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a9584b882f4c7cbb8a86a0d951940f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.538148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.538462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a9584b882f4c7cbb8a86a0d951940f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.539880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.539880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.540070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] PATH_INFO: `/v3/projects/af921c815d04402baf8b3bcd66881f30/users/8e817a7f3b8f4d49ae781584f12337a3/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.550434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a639446a-7f42-47e2-ac7f-e2d99a388763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a9584b882f4c7cbb8a86a0d951940f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:17.560598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1065/2156] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:17 2022] DELETE /identity/v3/users/95a9584b882f4c7cbb8a86a0d951940f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:17.562024 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af921c815d04402baf8b3bcd66881f30, user_id=8e817a7f3b8f4d49ae781584f12337a3, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.566012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.582942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1092/2157] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:17 2022] PUT /identity/v3/projects/af921c815d04402baf8b3bcd66881f30/users/8e817a7f3b8f4d49ae781584f12337a3/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:17.594569 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.594916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.595233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.628261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] MFA Rules not processed for user `8e817a7f3b8f4d49ae781584f12337a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:17.629530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.709739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1066/2158] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:17.714151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.715926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.823025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9fd53-3844-4bf5-99c0-877a3112131b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.828551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.829512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.829819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.830186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.830970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.833038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.857777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:17.873285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1093/2159] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:17 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:17.878508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.892829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:17.894592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:17.895821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:17.900828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477e64a-17c6-4642-ad68-656e7c694042 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:17.978294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:17.979005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:17.979323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:17.979740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:17.980442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:17.982723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:17.999256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac89325-7725-4c82-bc86-4482eeab172f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.007192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.008315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.011438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1067/2160] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:17 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:18.011543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.011543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] PATH_INFO: `/v3/projects/a1e7bee8c5d54e3bb2f9f596e7951441` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.011543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e7bee8c5d54e3bb2f9f596e7951441)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.012446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.012587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.023677 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2aa83-dab8-40bc-acb5-2f3a3d7ff145 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.028338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.028997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.029281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.029558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.030285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.031922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.042424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1068/2161] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:18.046651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.057046 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280873f-3506-4c24-945f-b88405b6867c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.062041 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e7bee8c5d54e3bb2f9f596e7951441', 'request_id': 'req-40fda7b4-bb07-45f2-ad67-d0b290813521'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:18.070114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e7bee8c5d54e3bb2f9f596e7951441', 'request_id': 'req-40fda7b4-bb07-45f2-ad67-d0b290813521'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:18.078232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e7bee8c5d54e3bb2f9f596e7951441', 'request_id': 'req-40fda7b4-bb07-45f2-ad67-d0b290813521'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:18.091066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] The token cache is being invalidate because project a1e7bee8c5d54e3bb2f9f596e7951441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:18.091375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:18.092561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40fda7b4-bb07-45f2-ad67-d0b290813521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:18.094933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1094/2162] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:17 2022] DELETE /identity/v3/projects/a1e7bee8c5d54e3bb2f9f596e7951441 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:18.100543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad9c4-9932-4423-8ea9-cac746dce1f4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.100832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad9c4-9932-4423-8ea9-cac746dce1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.101116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad9c4-9932-4423-8ea9-cac746dce1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.119083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-550ad9c4-9932-4423-8ea9-cac746dce1f4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:18.119349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.120237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.120525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.120684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-550ad9c4-9932-4423-8ea9-cac746dce1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.120808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] PATH_INFO: `/v3/projects/39573d7deb354742a8af3426bd1817d5/users/59463af6e0f344c3a46dfb3c1961a85f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.129264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1095/2163] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:18.136081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39573d7deb354742a8af3426bd1817d5, user_id=59463af6e0f344c3a46dfb3c1961a85f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.136985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.137289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.137574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.138752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.153458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1069/2164] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:18 2022] PUT /identity/v3/projects/39573d7deb354742a8af3426bd1817d5/users/59463af6e0f344c3a46dfb3c1961a85f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:18.157013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:18.157208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.158265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.158839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.230483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1096/2165] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:18.234823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.237360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec0305-a9fa-4774-8c61-0a590a112906 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.242322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.243151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.243483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.243840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.244652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.249578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3f1b3-7a0c-41b2-a118-6587cbfed6e7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.249803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.254982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.255707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.257346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.257346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.257346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:18.257592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.259096 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.264328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1070/2166] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:18.268653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.275907 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:18.276069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1097/2167] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:19:18.277247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.283268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8bb94-7ae8-48ae-b1aa-0a01dcfff4f9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.288680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359a6f0-52ca-435f-b18b-25a7fa799941 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.290755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9296b5-f42d-4cb5-a6ce-6e043e85f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.292120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9296b5-f42d-4cb5-a6ce-6e043e85f118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.292577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9296b5-f42d-4cb5-a6ce-6e043e85f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.292930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9296b5-f42d-4cb5-a6ce-6e043e85f118 admin admin] PATH_INFO: `/v3/projects/39573d7deb354742a8af3426bd1817d5/users/59463af6e0f344c3a46dfb3c1961a85f/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.293582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.294302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.294665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.295017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.295154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9296b5-f42d-4cb5-a6ce-6e043e85f118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39573d7deb354742a8af3426bd1817d5, user_id=59463af6e0f344c3a46dfb3c1961a85f, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.295853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.298764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.299232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9296b5-f42d-4cb5-a6ce-6e043e85f118 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.309809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:18.311493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1071/2168] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:18 2022] PUT /identity/v3/projects/39573d7deb354742a8af3426bd1817d5/users/59463af6e0f344c3a46dfb3c1961a85f/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:19:18.322906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.323650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.324167 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.355665 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1098/2169] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:18 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:18.360213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.363127 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] MFA Rules not processed for user `59463af6e0f344c3a46dfb3c1961a85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:18.364557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.446764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1072/2170] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:18.456945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4ba90-0522-4121-8d61-b24bc84d05ec admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.457592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.459148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.461787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.462455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.462743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.463022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.463747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.465645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.490589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1099/2171] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:18 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:18.494440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.504529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547031a-94a3-4af2-addb-351648b38fd1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.509270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.509927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.510217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.510501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.511259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.512857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.522978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5403b3-04f8-40b0-8723-dcdbdcd4c327 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.523464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1100/2172] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:18.527173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.529344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.529999 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.530265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.530541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.532894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.537011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fd2ff-fe58-4c08-b0a0-f83ab1f64133 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.542283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.543569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.543867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.544186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.544903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.546508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.560683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1101/2173] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:18.562982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.573065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10881c85-fa4e-4530-a5d2-272b3bf55d04 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.577826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.578737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.579023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.579871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] PATH_INFO: `/v3/projects/fff0f16469ef4a4da51e1ab59c569faf/users/4f24d0f557ae4c9093b9fd2416a52c9c/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.594564 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff0f16469ef4a4da51e1ab59c569faf, user_id=4f24d0f557ae4c9093b9fd2416a52c9c, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.597995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.598693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.600188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040b45e-b0db-4631-97c7-e7d50c3cd48c service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.609723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1073/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:18.611656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1102/2175] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:18 2022] PUT /identity/v3/projects/fff0f16469ef4a4da51e1ab59c569faf/users/4f24d0f557ae4c9093b9fd2416a52c9c/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:18.621700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3532d6-2f5b-4407-9567-4f6d76f88090 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.622008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3532d6-2f5b-4407-9567-4f6d76f88090 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.622297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3532d6-2f5b-4407-9567-4f6d76f88090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.641592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4c3532d6-2f5b-4407-9567-4f6d76f88090 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:18.643557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c3532d6-2f5b-4407-9567-4f6d76f88090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.673126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:18.725240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1074/2176] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:18.735026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:18.736966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:18.816890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed99a6-4ac0-4681-946c-37ab1bd6aca0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:18.826713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:18.827387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:18.827671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:18.827953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:18.842189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:18.843975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:18.857287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1103/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:19.701526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:19.702078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:19.702348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:19.730391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] MFA Rules not processed for user `4f24d0f557ae4c9093b9fd2416a52c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:19.731719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:19.812832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1075/2178] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:19.814073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:19.824235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33433b46-cd77-490c-a81c-862bbbb9439f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:19.828840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:19.829488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:19.829779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:19.830054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:19.830755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:19.832680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:19.867396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1104/2179] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:19 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:19.870497 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:19.891360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346c8f5-65c5-4246-8a05-ecab7c593860 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:19.952944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:19.953770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:19.954095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:19.955119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:19.955828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:19.958181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:19.978029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1076/2180] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:19 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:19:19.982683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:19.993489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442308ce-27f9-419e-a291-2edec7a38abc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:19.998216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:19.999026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:19.999350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:19.999634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:20.000367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:20.002106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:20.013285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1105/2181] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:20.018466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:20.029209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d83d-d62d-4fdf-9d7a-efdcafe9c38c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:20.034481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:20.035531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:20.035701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:20.035973 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] PATH_INFO: `/v3/projects/c0538ea4b14c478eb05135459e42ac50/users/557c23837e9240f9b3d9cbe1f80b7e47/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:20.050881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0538ea4b14c478eb05135459e42ac50, user_id=557c23837e9240f9b3d9cbe1f80b7e47, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:20.053564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:20.072700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1077/2182] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:20 2022] PUT /identity/v3/projects/c0538ea4b14c478eb05135459e42ac50/users/557c23837e9240f9b3d9cbe1f80b7e47/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:20.077324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:20.083445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:20.090206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b448d0-2d3e-48da-8509-bbc9afef0ce3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:20.156091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58aff7b-a9af-4d88-9bec-012396311fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:20.156769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aff7b-a9af-4d88-9bec-012396311fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:20.157060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aff7b-a9af-4d88-9bec-012396311fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:20.157923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58aff7b-a9af-4d88-9bec-012396311fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:20.158660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aff7b-a9af-4d88-9bec-012396311fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:20.160283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58aff7b-a9af-4d88-9bec-012396311fc0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:20.170796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1106/2183] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:19:20.175286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:20.185998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8b4ea-fe89-4029-be5e-150484c3ef96 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:20.194737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6a99b-045d-4aa1-aa1d-7e097bbea795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:20.196134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6a99b-045d-4aa1-aa1d-7e097bbea795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:20.196500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6a99b-045d-4aa1-aa1d-7e097bbea795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:20.196849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6a99b-045d-4aa1-aa1d-7e097bbea795 admin admin] PATH_INFO: `/v3/projects/c0538ea4b14c478eb05135459e42ac50/users/557c23837e9240f9b3d9cbe1f80b7e47/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:20.199166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6a99b-045d-4aa1-aa1d-7e097bbea795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0538ea4b14c478eb05135459e42ac50, user_id=557c23837e9240f9b3d9cbe1f80b7e47, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:20.201928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6a99b-045d-4aa1-aa1d-7e097bbea795 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:20.213131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1078/2184] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:20 2022] PUT /identity/v3/projects/c0538ea4b14c478eb05135459e42ac50/users/557c23837e9240f9b3d9cbe1f80b7e47/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:21.039103 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:21.040511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:21.040965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:21.073533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] MFA Rules not processed for user `557c23837e9240f9b3d9cbe1f80b7e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:21.075196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:21.207107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1107/2185] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:21.217266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:21.217816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:21.217911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:21.241287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:21.243567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] MFA Rules not processed for user `4f24d0f557ae4c9093b9fd2416a52c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:21.245102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:21.252177 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:21.315001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1079/2186] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:21.326362 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:21.328144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:21.342130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a62ae-8584-4f99-b11e-f4bc788712c1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:21.347056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:21.348031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:21.348393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:21.348777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] PATH_INFO: `/v3/users/8e817a7f3b8f4d49ae781584f12337a3` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:21.350059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e817a7f3b8f4d49ae781584f12337a3)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:21.352169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:21.382963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:21.404822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e817a7f3b8f4d49ae781584f12337a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:21.412025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b953e6-6537-4c0e-92e0-67a259169f65 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:21.412576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e817a7f3b8f4d49ae781584f12337a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:21.413270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e817a7f3b8f4d49ae781584f12337a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:21.418405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:21.419754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:21.420047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:21.420335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:21.422133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:21.426295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e817a7f3b8f4d49ae781584f12337a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:21.427080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d9ed53b7-50f5-4494-b4d3-2c5d286339fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e817a7f3b8f4d49ae781584f12337a3'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:21.433333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:21.435252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:21.441144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1108/2187] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:21 2022] DELETE /identity/v3/users/8e817a7f3b8f4d49ae781584f12337a3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:21.445181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:21.445311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1080/2188] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:19:21.447430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:21.447742 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:21.465319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:21.466574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:21.538253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1109/2189] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:19:21.547763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:21.549845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:21.619629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d251e55-494c-4942-a095-069c7651e07d service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:21.669418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:21.670071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:21.670354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:21.670628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:21.681059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:21.682683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:21.689956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:21.698625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1081/2190] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:22.008030 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:22.009923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:22.023648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2990b1-301e-4b57-b780-098040a4ef92 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:22.031021 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:22.032039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:22.033210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:22.033377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] PATH_INFO: `/v3/projects/af921c815d04402baf8b3bcd66881f30` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:22.037107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af921c815d04402baf8b3bcd66881f30)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:22.051459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:22.138160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af921c815d04402baf8b3bcd66881f30', 'request_id': 'req-be801c10-c663-45a1-a43b-dd8c92c7f1a1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.150552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af921c815d04402baf8b3bcd66881f30', 'request_id': 'req-be801c10-c663-45a1-a43b-dd8c92c7f1a1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.163203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af921c815d04402baf8b3bcd66881f30', 'request_id': 'req-be801c10-c663-45a1-a43b-dd8c92c7f1a1'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.174872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] The token cache is being invalidate because project af921c815d04402baf8b3bcd66881f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:22.175214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.175874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.177433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1110/2191] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:22 2022] DELETE /identity/v3/projects/af921c815d04402baf8b3bcd66881f30 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:22.182276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:22.209131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69674381-f84a-4e10-8a92-e3a2fbbcf294 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:22.290394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:22.291533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:22.291709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:22.292172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] PATH_INFO: `/v3/users/59463af6e0f344c3a46dfb3c1961a85f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:22.293602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59463af6e0f344c3a46dfb3c1961a85f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:22.295695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:22.357481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59463af6e0f344c3a46dfb3c1961a85f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.366069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59463af6e0f344c3a46dfb3c1961a85f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.412775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59463af6e0f344c3a46dfb3c1961a85f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.414199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59463af6e0f344c3a46dfb3c1961a85f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.422875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-01a8290c-6545-42a8-906a-51433a83fa30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59463af6e0f344c3a46dfb3c1961a85f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:22.429668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1082/2192] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:19:22 2022] DELETE /identity/v3/users/59463af6e0f344c3a46dfb3c1961a85f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:23.067724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.069271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:23.082032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be801c10-c663-45a1-a43b-dd8c92c7f1a1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.112127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:23.148794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.149661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.149946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.150224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] PATH_INFO: `/v3/projects/39573d7deb354742a8af3426bd1817d5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.151437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39573d7deb354742a8af3426bd1817d5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.153382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.212353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39573d7deb354742a8af3426bd1817d5', 'request_id': 'req-1f82d950-84ed-430c-84a4-c04cfbda4bb4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:23.224880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39573d7deb354742a8af3426bd1817d5', 'request_id': 'req-1f82d950-84ed-430c-84a4-c04cfbda4bb4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:23.232809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39573d7deb354742a8af3426bd1817d5', 'request_id': 'req-1f82d950-84ed-430c-84a4-c04cfbda4bb4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:23.243730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] The token cache is being invalidate because project 39573d7deb354742a8af3426bd1817d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:19:23.244022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:23.244672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-1f82d950-84ed-430c-84a4-c04cfbda4bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:19:23.246235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1111/2193] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:19:23 2022] DELETE /identity/v3/projects/39573d7deb354742a8af3426bd1817d5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:23.252377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.252977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.253481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.273018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:23.274221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:23.340432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1083/2194] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:23.348538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.348829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.349109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.369926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:23.371201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:23.379692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1112/2195] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:23.383752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.394984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a0028-a875-4832-b21b-bb6345ba8cee None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.400258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.400978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.401480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.401594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.402452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:19:23.404236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.406111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.425124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1084/2196] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:19:23.426611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.436755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111280ff-3edd-4d3b-a021-9ed2db07a0ba None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.441736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.444156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.444447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.444729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.445450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.447406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.478078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1113/2197] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:19:23 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:23.482039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.493594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50321b1b-ca0a-4da2-8390-3397cbee37a4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.498930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:23.575914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.576686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.576953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.577283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.578004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.581344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.609941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1085/2198] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:19:23 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:19:23.612236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.623196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82acf5b9-5892-4b31-a429-7df720cec8de admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.628171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.628857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.629135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.629419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.630159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.631810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.643262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1114/2199] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:23.647287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.657234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f88eb4-cd99-40fa-b884-4b7a92139918 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.662461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6507d6-5c42-4fa7-ab7d-4f4792217a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.663152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6507d6-5c42-4fa7-ab7d-4f4792217a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.663440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6507d6-5c42-4fa7-ab7d-4f4792217a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.663724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6507d6-5c42-4fa7-ab7d-4f4792217a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.664464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6507d6-5c42-4fa7-ab7d-4f4792217a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.666139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6507d6-5c42-4fa7-ab7d-4f4792217a3c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.676775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1086/2200] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:19:23.680924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.691956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dbf45-ddcb-41c3-8f14-8ffe95c62b99 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.696718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.697609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.697901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.698185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] PATH_INFO: `/v3/projects/5041f55cf6e74a9093c56d8170e5cc93/users/b6f618027053483ea05c2a43963feb16/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.719489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5041f55cf6e74a9093c56d8170e5cc93, user_id=b6f618027053483ea05c2a43963feb16, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.722753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.736989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1115/2201] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:19:23 2022] PUT /identity/v3/projects/5041f55cf6e74a9093c56d8170e5cc93/users/b6f618027053483ea05c2a43963feb16/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:19:23.748526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d98d1-2a98-470c-95f1-4ec83d06e6e6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.748899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d98d1-2a98-470c-95f1-4ec83d06e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.749306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d98d1-2a98-470c-95f1-4ec83d06e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.776939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-de6d98d1-2a98-470c-95f1-4ec83d06e6e6 None None] MFA Rules not processed for user `b6f618027053483ea05c2a43963feb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:23.778226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-de6d98d1-2a98-470c-95f1-4ec83d06e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:23.849912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1087/2202] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:23.861100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:23.862756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:23.919493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e11ac6-cc67-4019-be5b-466ca3d5f8a0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:23.923186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:23.923833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:23.924122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:23.924406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:23.930550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:23.932919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:23.934928 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:23.946659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1116/2203] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:33.847301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:33.848240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:33.848838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:33.849325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:33.878306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:33.880316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:33.947278 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:33.976834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1088/2204] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:19:34.024896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:34.026346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:34.112840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272f86a-b94f-4584-894e-f94084d69938 service glance] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:34.120606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9949d1-fa41-4daf-bff2-7da0b2e3f5cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:34.121282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9949d1-fa41-4daf-bff2-7da0b2e3f5cf service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:34.121572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9949d1-fa41-4daf-bff2-7da0b2e3f5cf service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:34.121852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9949d1-fa41-4daf-bff2-7da0b2e3f5cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:34.135293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9949d1-fa41-4daf-bff2-7da0b2e3f5cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:34.136896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9949d1-fa41-4daf-bff2-7da0b2e3f5cf service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:34.147122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1117/2205] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:19:39.452478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:19:39.454156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:39.539893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca309d-0404-45cf-8969-dae9a6d76625 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:19:39.545376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:19:39.546782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:39.547178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:39.547614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:39.550555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:39.636263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:19:39.638026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e3656-114e-42de-a7ec-e48ac36c7065 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:19:39.650559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1089/2206] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:19:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:19:44.144084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=32 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:49.645918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=75 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:19:50.144869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:19:50.145437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:19:50.145437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:19:50.162745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] MFA Rules not processed for user `acee9273e0714017bb29bbc578847b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:19:50.164047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:19:50.228433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1118/2207] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:19:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:00.220580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=25 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:00.356354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513fb6-44dd-4de1-b853-0123d4331ee7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:00.356951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513fb6-44dd-4de1-b853-0123d4331ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:00.356951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513fb6-44dd-4de1-b853-0123d4331ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:00.382995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d4513fb6-44dd-4de1-b853-0123d4331ee7 None None] MFA Rules not processed for user `eb03b2aff9674231b7275a12171a3197`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:00.384753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d4513fb6-44dd-4de1-b853-0123d4331ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:00.454649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1090/2208] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:01.161055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:01.162886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:01.286805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f92d8-e058-4e38-93d2-936fe02738c8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:01.294177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:01.295428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:01.295791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:01.296083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] PATH_INFO: `/v3/users/7cba6211fafb4d6885c130eb889b5c07` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:01.297316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cba6211fafb4d6885c130eb889b5c07)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:01.299595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:01.375872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cba6211fafb4d6885c130eb889b5c07'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:01.388189 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cba6211fafb4d6885c130eb889b5c07'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:01.388857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cba6211fafb4d6885c130eb889b5c07'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:01.415639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cba6211fafb4d6885c130eb889b5c07'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:01.416391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cba6211fafb4d6885c130eb889b5c07'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:01.446301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:01.446970 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:01.447115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:01.449241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1119/2209] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:01 2022] DELETE /identity/v3/users/7cba6211fafb4d6885c130eb889b5c07 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:01.471646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:01.473257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:01.612460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1091/2210] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:01.706055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:01.710066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:01.911551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640a2fb-a058-423a-bfa8-83d73c246c05 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:01.918338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:01.919762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:01.919762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:01.919997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:01.961440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:01.962937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:02.011605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1120/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:03.556370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:03.558543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:03.585643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1148a05-cf84-4dd5-8714-0a55311b6c06 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:03.598515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:03.599360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:03.599643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:03.600212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] PATH_INFO: `/v3/projects/2bc2ba2f80a0415fb612ae2a17b0c0ae` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:03.602398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc2ba2f80a0415fb612ae2a17b0c0ae)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:03.604365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:03.696505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc2ba2f80a0415fb612ae2a17b0c0ae', 'request_id': 'req-32d61987-5cee-44ed-a233-b25b9bc9f2f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:03.711986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc2ba2f80a0415fb612ae2a17b0c0ae', 'request_id': 'req-32d61987-5cee-44ed-a233-b25b9bc9f2f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:03.727713 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc2ba2f80a0415fb612ae2a17b0c0ae', 'request_id': 'req-32d61987-5cee-44ed-a233-b25b9bc9f2f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:03.753333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] The token cache is being invalidate because project 2bc2ba2f80a0415fb612ae2a17b0c0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:03.754028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:03.757246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-32d61987-5cee-44ed-a233-b25b9bc9f2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:03.759520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1092/2212] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:03 2022] DELETE /identity/v3/projects/2bc2ba2f80a0415fb612ae2a17b0c0ae => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:04.063425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:04.065509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.082844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5fc34-24a3-41e1-848c-16126fb3809d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:04.112858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:04.188567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:04.191364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.191552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.191853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] PATH_INFO: `/v3/users/b6f618027053483ea05c2a43963feb16` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.196382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f618027053483ea05c2a43963feb16)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:04.202675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:04.288525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0460-c679-412f-b055-3e34654c749e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.288809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0460-c679-412f-b055-3e34654c749e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.289260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0460-c679-412f-b055-3e34654c749e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.290790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1093/2213] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 11:20:04.302923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f618027053483ea05c2a43963feb16'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.317438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f618027053483ea05c2a43963feb16'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.318197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f618027053483ea05c2a43963feb16'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.331199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.331730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.332158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.336066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f618027053483ea05c2a43963feb16'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.336837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-9bf9f05f-0003-41d6-ae2b-2b95a1f90059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f618027053483ea05c2a43963feb16'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.354108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1121/2214] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:04 2022] DELETE /identity/v3/users/b6f618027053483ea05c2a43963feb16 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:04.359098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.359585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.360120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.376029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] MFA Rules not processed for user `8463ca23f8c447dfad7ae62e7ba084e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:04.377574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.386650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:04.389491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.444997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:04.527682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1122/2215] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:04.530331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:04.532369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.549703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1094/2216] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:04.550575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:04.551925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.557754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d22665a-a82a-4435-9aca-c791993a2be1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:04.582531 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:04.583525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.583811 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.584087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] PATH_INFO: `/v3/users/4f24d0f557ae4c9093b9fd2416a52c9c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.586572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f24d0f557ae4c9093b9fd2416a52c9c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:04.588722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:04.658272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:04.658501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1f150-b274-49a6-93ad-fbd851133afd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:04.663415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:04.664071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.665515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.665823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.676020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f24d0f557ae4c9093b9fd2416a52c9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.678095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:04.679650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:04.693059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1095/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:04.694135 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:04.696132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.710243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f24d0f557ae4c9093b9fd2416a52c9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.719075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c51229-f97f-4655-8708-1821c8d60a1a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:04.720429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f24d0f557ae4c9093b9fd2416a52c9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.725065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:04.725954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:04.726421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:04.726990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:04.729143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:04.742028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:04.743959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:04.758094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1096/2218] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:04.770176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f24d0f557ae4c9093b9fd2416a52c9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.772305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f24d0f557ae4c9093b9fd2416a52c9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:04.817191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1123/2219] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:04 2022] DELETE /identity/v3/users/4f24d0f557ae4c9093b9fd2416a52c9c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:05.253957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:05.255448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:05.279193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796c9d0-c596-4431-8de9-2fc89c60a664 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:05.427214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:05.429577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.430449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.431392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] PATH_INFO: `/v3/projects/fff0f16469ef4a4da51e1ab59c569faf` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.432262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff0f16469ef4a4da51e1ab59c569faf)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:05.434271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:05.477549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:05.478494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:05.502143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a47a6b-1f0a-474d-b9e5-db1095d06021 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:05.527833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:05.528726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.529014 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.529292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] PATH_INFO: `/v3/projects/5041f55cf6e74a9093c56d8170e5cc93` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.530579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5041f55cf6e74a9093c56d8170e5cc93)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:05.532544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:05.552549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff0f16469ef4a4da51e1ab59c569faf', 'request_id': 'req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.570619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff0f16469ef4a4da51e1ab59c569faf', 'request_id': 'req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.576718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:05.585217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff0f16469ef4a4da51e1ab59c569faf', 'request_id': 'req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.601983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] The token cache is being invalidate because project fff0f16469ef4a4da51e1ab59c569faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:05.602281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.602967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.604659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1097/2220] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:05 2022] DELETE /identity/v3/projects/fff0f16469ef4a4da51e1ab59c569faf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:05.608928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:05.611954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:05.631520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5041f55cf6e74a9093c56d8170e5cc93', 'request_id': 'req-7c8eb41f-ce80-48ac-baa2-3c762544682d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.649425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5041f55cf6e74a9093c56d8170e5cc93', 'request_id': 'req-7c8eb41f-ce80-48ac-baa2-3c762544682d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.670744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5041f55cf6e74a9093c56d8170e5cc93', 'request_id': 'req-7c8eb41f-ce80-48ac-baa2-3c762544682d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.699773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1ddf-67dc-454d-9eea-8fe56f71f2cc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:05.717335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] The token cache is being invalidate because project 5041f55cf6e74a9093c56d8170e5cc93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:05.717698 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.719154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7c8eb41f-ce80-48ac-baa2-3c762544682d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.722911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1124/2221] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:05 2022] DELETE /identity/v3/projects/5041f55cf6e74a9093c56d8170e5cc93 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:05.731224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894b376-c646-4f4a-bd42-c8e6fce30f48 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.732961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894b376-c646-4f4a-bd42-c8e6fce30f48 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.733274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894b376-c646-4f4a-bd42-c8e6fce30f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.791313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e894b376-c646-4f4a-bd42-c8e6fce30f48 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:05.793851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e894b376-c646-4f4a-bd42-c8e6fce30f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:05.805158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:05.806472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.806988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.807526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] PATH_INFO: `/v3/users/557c23837e9240f9b3d9cbe1f80b7e47` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.809080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=557c23837e9240f9b3d9cbe1f80b7e47)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:05.811754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:05.823144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1125/2222] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:05.825935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.826237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.826525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.860017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:05.867412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:05.886573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1126/2223] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:05.887799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:05.903220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8278-4381-4be0-b5c4-18dcf0514d2f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:05.910985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:05.912013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.912403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.912787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.914359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:20:05.914797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:05.916888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:05.949138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1127/2224] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:20:05.954019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:05.968382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557c23837e9240f9b3d9cbe1f80b7e47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:05.973062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d02099-7672-48db-9aaa-0996ec2eaa40 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:05.980210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:05.981345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:05.981720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:05.982062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:05.982996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:05.986877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:05.989484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557c23837e9240f9b3d9cbe1f80b7e47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.017039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557c23837e9240f9b3d9cbe1f80b7e47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.018923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557c23837e9240f9b3d9cbe1f80b7e47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.033193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557c23837e9240f9b3d9cbe1f80b7e47'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.044979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1128/2225] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:20:05 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:06.049975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:06.051505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1098/2226] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:05 2022] DELETE /identity/v3/users/557c23837e9240f9b3d9cbe1f80b7e47 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:06.059224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:06.167089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:06.195420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab3a8-1123-4201-91a2-d33d08f57495 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:06.284782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:06.285877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.286432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.287207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.287596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:06.290321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:06.323215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1129/2227] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:20:06 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:06.326888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:06.338634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f5d16-0b1c-4804-9402-875395803c1c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:06.345807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:06.346707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.347194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.347656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.348591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:06.350365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:06.359138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:06.360739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:06.363948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:06.371075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1099/2228] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:06.375269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:06.394549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0495d-9b41-4a2b-8abf-bf1ad5a8c398 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:06.410004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc401fd-d14d-425b-b4af-9ade00a96636 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:06.417672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:06.417672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.417672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.417672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] PATH_INFO: `/v3/projects/c0538ea4b14c478eb05135459e42ac50` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.418808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0538ea4b14c478eb05135459e42ac50)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:06.424090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:06.424660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:06.425467 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.425788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.426134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.426945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:06.429783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:06.451580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1100/2229] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:06.453844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:06.500032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da399e4a-701c-4e98-bcfc-469ca6ddd8d5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:06.515797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ecc81-1065-4c38-977d-da55cf0c9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:06.519496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ecc81-1065-4c38-977d-da55cf0c9e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.519794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ecc81-1065-4c38-977d-da55cf0c9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.520084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ecc81-1065-4c38-977d-da55cf0c9e50 admin admin] PATH_INFO: `/v3/projects/ffe6616582494833b929111db26dbaf1/users/e62fa89a21954fb3a90a9441112a9c55/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.558941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ecc81-1065-4c38-977d-da55cf0c9e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe6616582494833b929111db26dbaf1, user_id=e62fa89a21954fb3a90a9441112a9c55, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:06.562813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ecc81-1065-4c38-977d-da55cf0c9e50 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:06.566266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0538ea4b14c478eb05135459e42ac50', 'request_id': 'req-c7b2dd9f-b6fb-4612-b158-78c48822cab5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.590923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1101/2230] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:06 2022] PUT /identity/v3/projects/ffe6616582494833b929111db26dbaf1/users/e62fa89a21954fb3a90a9441112a9c55/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:06.605592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0538ea4b14c478eb05135459e42ac50', 'request_id': 'req-c7b2dd9f-b6fb-4612-b158-78c48822cab5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.626374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0538ea4b14c478eb05135459e42ac50', 'request_id': 'req-c7b2dd9f-b6fb-4612-b158-78c48822cab5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.666869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.666869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.666869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.681129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] The token cache is being invalidate because project c0538ea4b14c478eb05135459e42ac50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:06.681441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.683491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c7b2dd9f-b6fb-4612-b158-78c48822cab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:06.688033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1130/2231] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:06 2022] DELETE /identity/v3/projects/c0538ea4b14c478eb05135459e42ac50 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:20:06.695697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf926ef-b10c-41af-955c-5c7247e922ce None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.696241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf926ef-b10c-41af-955c-5c7247e922ce None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.696628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf926ef-b10c-41af-955c-5c7247e922ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:06.703119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] MFA Rules not processed for user `e62fa89a21954fb3a90a9441112a9c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:06.704315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:06.737465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aaf926ef-b10c-41af-955c-5c7247e922ce None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:06.740686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aaf926ef-b10c-41af-955c-5c7247e922ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:06.868814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1102/2232] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:06.886429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:06.888222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:06.898441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1131/2233] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:20:06.973058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:06.973512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:06.973685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.024273 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:07.025441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:07.048779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1132/2234] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:20:07.050176 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:07.055165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:07.065133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7525-ae94-4911-9176-38ffd76144a6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.072929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.073759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.074486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.074892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.075974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:20:07.076869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.079125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.080326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7a187-2a08-4b29-84ad-ec4f6bb5c250 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.084801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.085465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.085748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.086023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.100307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1133/2235] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:20:07.101224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:07.103408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.105048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.117597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1103/2236] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:20:07.117752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819d834-f9fb-46f7-830c-93cfd06dc960 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.123301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.124064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.124467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.124776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.125567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.133655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.204077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1134/2237] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:20:07 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:07.213091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:07.269974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49dc67-aca3-4bf9-9229-8df87096de7d service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.354458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:07.369573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.370844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.371285 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.371723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.372628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.375205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.411134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1104/2238] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:20:07 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:07.414790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:07.430669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1db74-ca97-4a69-ab4e-29dd2a61ecc4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.436819 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.437890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.438279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.439513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.440633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.442260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.472852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1135/2239] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:07.477988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:07.496424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ccc6-c35a-40f4-95d8-dc88c8c2764a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.505228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087e448-c942-446f-a177-8f26302dd095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.507332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e448-c942-446f-a177-8f26302dd095 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.507993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e448-c942-446f-a177-8f26302dd095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.508484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087e448-c942-446f-a177-8f26302dd095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.510203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087e448-c942-446f-a177-8f26302dd095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.512652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087e448-c942-446f-a177-8f26302dd095 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.539427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1105/2240] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:07.539631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:07.553680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383002ad-3845-4e30-b629-f7936d71248c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:07.562141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:07.564712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.565342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.566229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] PATH_INFO: `/v3/projects/443a525e544f4ff6a96c08039d88471b/users/655617ba12ff4a68a6281adb06d6c243/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.590607 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443a525e544f4ff6a96c08039d88471b, user_id=655617ba12ff4a68a6281adb06d6c243, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:07.598511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:07.634926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:07.635158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1136/2241] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:07 2022] PUT /identity/v3/projects/443a525e544f4ff6a96c08039d88471b/users/655617ba12ff4a68a6281adb06d6c243/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:07.635260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:07.635515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:07.719006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] MFA Rules not processed for user `655617ba12ff4a68a6281adb06d6c243`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:07.720826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:07.891295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1106/2242] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:07.897425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.021625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc5148-e354-431e-8588-b036fbfffea8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:08.027837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:08.028807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.029297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.029741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.030711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:08.035407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:08.080574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1137/2243] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:20:07 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:08.083154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.128905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001a9c9-e4ca-4266-8489-484cc56b2682 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:08.234611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:08.235386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.236224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.236514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.237320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:08.239432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:08.275028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.275563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1107/2244] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:20:08 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:08.288499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702c95d-c4fe-4832-b936-2d25b2228e7b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:08.293918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:08.294729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.295071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.295388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.296183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:08.298016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:08.312379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1138/2245] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:20:08.316821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.328716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef312b-87e2-40ae-850a-d0741d8ba209 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:08.334343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcb455-69db-4b08-969a-e53109cd5e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:08.335158 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb455-69db-4b08-969a-e53109cd5e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.335527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb455-69db-4b08-969a-e53109cd5e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.335873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcb455-69db-4b08-969a-e53109cd5e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.336695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb455-69db-4b08-969a-e53109cd5e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:08.338411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcb455-69db-4b08-969a-e53109cd5e87 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:08.357650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1108/2246] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:20:08.361894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.377820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac96e7-6f18-4e9a-95f2-117adcd7b704 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:08.385164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:08.388053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.388053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.388053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] PATH_INFO: `/v3/projects/c45c442f939f4e1590032989a7703167/users/0e2672cb1e8e4ab3a8d5c650da2f9a68/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.416317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45c442f939f4e1590032989a7703167, user_id=0e2672cb1e8e4ab3a8d5c650da2f9a68, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:08.419670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:08.446910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1139/2247] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:08 2022] PUT /identity/v3/projects/c45c442f939f4e1590032989a7703167/users/0e2672cb1e8e4ab3a8d5c650da2f9a68/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:20:08.459372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.459725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.459936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.506656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] MFA Rules not processed for user `0e2672cb1e8e4ab3a8d5c650da2f9a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:08.508155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:08.593336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:08.647106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1109/2248] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:08.648492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.706131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:08.757563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a235a-61b2-4148-be74-7b45b168aedd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:08.765037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:08.766345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:08.768136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:08.768525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:08.769355 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:08.771543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:08.835106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1140/2249] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:20:08 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:08.835325 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:08.850633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74932c4-7d90-441e-b68c-d2b678c76b71 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:09.067211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:09.076723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:09.077275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:09.078039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:09.079848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:09.084180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:09.121265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1110/2250] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:20:08 2022] POST /identity/v3/users => generated 295 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:09.124898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:09.140618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925d522-6bac-4a7d-98c6-a23d7f51cc86 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:09.147205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:09.148256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:09.148888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:09.149542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:09.150484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:09.152979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:09.170804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1141/2251] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:09.175572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:09.191007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2db67-a048-46a5-b6a1-033a15256761 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:09.196937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:09.197888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:09.198180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:09.198588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] PATH_INFO: `/v3/projects/1d7f3289efc74ad2bb1ef76be758e2ba/users/c063b7b343eb45eea2fab962113bc51b/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:09.226541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f3289efc74ad2bb1ef76be758e2ba, user_id=c063b7b343eb45eea2fab962113bc51b, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:09.229345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:09.281974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1111/2252] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:09 2022] PUT /identity/v3/projects/1d7f3289efc74ad2bb1ef76be758e2ba/users/c063b7b343eb45eea2fab962113bc51b/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:09.283427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:09.393659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bd5dc-3f48-4221-95a0-865c6fe7dc72 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:09.551964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f7ce-97e2-4908-b8b0-b0c35c009935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:09.552901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f7ce-97e2-4908-b8b0-b0c35c009935 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:09.553420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f7ce-97e2-4908-b8b0-b0c35c009935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:09.554699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f7ce-97e2-4908-b8b0-b0c35c009935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:09.555722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f7ce-97e2-4908-b8b0-b0c35c009935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:09.557571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f7ce-97e2-4908-b8b0-b0c35c009935 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:09.583255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1142/2253] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:09.586513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:09.675509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17ca3-bea2-40d2-ab3c-0799256222f8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:09.688212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:09.690972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:09.691393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:09.691756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] PATH_INFO: `/v3/projects/1d7f3289efc74ad2bb1ef76be758e2ba/users/c063b7b343eb45eea2fab962113bc51b/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:09.697250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7f3289efc74ad2bb1ef76be758e2ba, user_id=c063b7b343eb45eea2fab962113bc51b, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:09.701084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:09.719398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1112/2254] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:09 2022] PUT /identity/v3/projects/1d7f3289efc74ad2bb1ef76be758e2ba/users/c063b7b343eb45eea2fab962113bc51b/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:09.729780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:09.730647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:09.731334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:09.794649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] MFA Rules not processed for user `c063b7b343eb45eea2fab962113bc51b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:09.796099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:09.895957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:09.918005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1143/2255] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:09.930028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:09.931820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:09.978579 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:10.019384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f68b1-8618-41cd-aeea-c8de2926a670 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:10.023113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe18b4-c53a-44cb-a7cd-7906ff388689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:10.023837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe18b4-c53a-44cb-a7cd-7906ff388689 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:10.024125 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe18b4-c53a-44cb-a7cd-7906ff388689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:10.024399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe18b4-c53a-44cb-a7cd-7906ff388689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:10.086831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe18b4-c53a-44cb-a7cd-7906ff388689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:10.088391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe18b4-c53a-44cb-a7cd-7906ff388689 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:10.100876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1113/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:11.930806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:11.947939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a5e8e-c31a-4562-a6ea-5c37bd6cc37f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:11.960523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:11.961251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:11.961663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:11.961884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:12.050456 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:12.053861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:12.071220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1144/2257] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:12.135766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:12.136843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:12.137594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:12.167747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:12.169126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:12.302452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1114/2258] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:12.313578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:12.316151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:12.412599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dce35f-0753-4aa4-9e58-4004f58795c5 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:12.420290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065072d5-b13b-4500-aea8-973dbc1560a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:12.421093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065072d5-b13b-4500-aea8-973dbc1560a6 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:12.421384 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065072d5-b13b-4500-aea8-973dbc1560a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:12.421704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065072d5-b13b-4500-aea8-973dbc1560a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:12.433438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065072d5-b13b-4500-aea8-973dbc1560a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:12.435815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065072d5-b13b-4500-aea8-973dbc1560a6 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:12.448411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1145/2259] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:20:12.869671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:12.880524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eae21f-8640-4433-b613-e5216bef6787 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:12.890829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:12.892438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:12.892887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:12.893435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:12.905553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:12.907235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:12.929419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1115/2260] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:13.711099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:13.711638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:13.711747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:13.732532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:13.733756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:13.743533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1146/2261] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jun 29 11:20:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:13.762853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:13.776625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482be602-7b38-415c-9323-fd7da79cb10a service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:13.782110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:13.782985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:13.783304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:13.783589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:13.792538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:13.794049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:13.803684 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1116/2262] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:20:16.592918 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:16.595235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:16.714577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd866ef3-19b4-414c-a44e-d54f83517e94 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:16.727801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:16.729213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:16.729655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:16.730204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] PATH_INFO: `/v3/users/fbe4191263234dfa9a035dca48d22cae` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:16.731636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe4191263234dfa9a035dca48d22cae)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:16.733936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:16.753411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:16.810979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe4191263234dfa9a035dca48d22cae'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:16.831144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe4191263234dfa9a035dca48d22cae'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:16.831845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe4191263234dfa9a035dca48d22cae'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:16.863963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe4191263234dfa9a035dca48d22cae'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:16.865039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe4191263234dfa9a035dca48d22cae'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:16.891080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1147/2263] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:16 2022] DELETE /identity/v3/users/fbe4191263234dfa9a035dca48d22cae => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:17.105034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.120227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a7231-f2ca-4826-a576-2a1159041f3c service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.157532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.159078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:17.261765 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.262752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.263192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.263483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] PATH_INFO: `/v3/users/655617ba12ff4a68a6281adb06d6c243` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.264895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=655617ba12ff4a68a6281adb06d6c243)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.267544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.270128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:17.328224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dae54-d562-4e9e-b902-f9ac7b43f61b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.336117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.337008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.337301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.337630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] PATH_INFO: `/v3/projects/6ae3c8dbe2d0415c823cb76732f4dcb5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.338852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae3c8dbe2d0415c823cb76732f4dcb5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.341603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.354733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655617ba12ff4a68a6281adb06d6c243'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.383087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655617ba12ff4a68a6281adb06d6c243'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.401867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655617ba12ff4a68a6281adb06d6c243'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.402631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655617ba12ff4a68a6281adb06d6c243'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.416082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5f3808cc-084e-46d9-9fb8-7117899b14dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655617ba12ff4a68a6281adb06d6c243'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.420149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae3c8dbe2d0415c823cb76732f4dcb5', 'request_id': 'req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.424619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1117/2264] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:17 2022] DELETE /identity/v3/users/655617ba12ff4a68a6281adb06d6c243 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:17.431256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.431256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.431256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.435416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae3c8dbe2d0415c823cb76732f4dcb5', 'request_id': 'req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.442865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae3c8dbe2d0415c823cb76732f4dcb5', 'request_id': 'req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.464815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] The token cache is being invalidate because project 6ae3c8dbe2d0415c823cb76732f4dcb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:17.465587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.467519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-48a5f1aa-abc7-49a6-a8d2-c8bb3af42faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:17.470367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:17.471752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:17.476414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1148/2265] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:17 2022] DELETE /identity/v3/projects/6ae3c8dbe2d0415c823cb76732f4dcb5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:17.478219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28929-e5fc-4fb9-8882-a554ad2c5add None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.478518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28929-e5fc-4fb9-8882-a554ad2c5add None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.480092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a28929-e5fc-4fb9-8882-a554ad2c5add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.531435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:17.547231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-80a28929-e5fc-4fb9-8882-a554ad2c5add None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:17.550376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-80a28929-e5fc-4fb9-8882-a554ad2c5add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:17.556415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1118/2266] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:20:17.567587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.569343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1149/2267] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:17.572720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:17.577310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.577604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.577890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.608134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:17.611073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:17.622919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1150/2268] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:17.625094 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.639215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8224933-03a5-47c2-9740-5437cb867df7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.644726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.646648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.647290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.647290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.648240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:20:17.649417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.653284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.667786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1151/2269] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:20:17.671852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.685561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4b3e4-dee1-430c-b47e-cd40336e78c9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.686784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09223b-9364-4146-8f11-9449d1b6a025 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.689589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.690273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.690522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.690804 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.692325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.693058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.693415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.693769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.694536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.696554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.699679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:17.703208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.706392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.728193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1119/2270] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:20:17.740005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1152/2271] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:20:17 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:20:17.741384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.755795 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d8137-b872-41b5-bbdf-41398b66fe0c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.870637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.871461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.873571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.873571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.873571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.878126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.911375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1120/2272] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:20:17 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:17.913095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.923553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27368c4-7913-4a7a-8c8c-4c921351f256 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.928651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.929328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.929662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.930610 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.931385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.932999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.949622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1153/2273] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:17.950355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:17.964410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b55b5-8a2e-47ad-9fd1-ee5846af0a39 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:17.969868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cd61f-0f6a-454d-82d6-853a70352f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:17.974191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd61f-0f6a-454d-82d6-853a70352f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:17.974631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd61f-0f6a-454d-82d6-853a70352f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:17.974921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cd61f-0f6a-454d-82d6-853a70352f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:17.976003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd61f-0f6a-454d-82d6-853a70352f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:17.978318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cd61f-0f6a-454d-82d6-853a70352f42 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:17.990821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1121/2274] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:17.994912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:18.014139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6d9dc-f90b-435d-abc0-075d9fdd59ff admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:18.028271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:18.029311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:18.029754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:18.035073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] PATH_INFO: `/v3/projects/ceaadedb270447d0954e6876296fa052/users/ea0ef27b984c4b829edc0ac0d785021b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:18.084750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceaadedb270447d0954e6876296fa052, user_id=ea0ef27b984c4b829edc0ac0d785021b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:18.089225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:18.130766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1154/2275] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:17 2022] PUT /identity/v3/projects/ceaadedb270447d0954e6876296fa052/users/ea0ef27b984c4b829edc0ac0d785021b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:18.143366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:18.143366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:18.143366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:18.203959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] MFA Rules not processed for user `ea0ef27b984c4b829edc0ac0d785021b`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:18.205917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:18.326377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:18.333489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:18.358555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1122/2276] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:18.370611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:18.385604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:18.483091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942f456-c916-4092-b83e-535e9b8d4d39 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:18.487452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:18.488506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:18.488858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:18.489224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:18.491635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd21b12-918c-4966-9e84-c5e792d1890d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:18.498565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:18.500061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:18.500544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:18.500908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] PATH_INFO: `/v3/projects/443a525e544f4ff6a96c08039d88471b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:18.502911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443a525e544f4ff6a96c08039d88471b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:18.505321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:18.512017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:18.514274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:18.529990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1123/2277] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:20:18.599414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443a525e544f4ff6a96c08039d88471b', 'request_id': 'req-f87610f9-7996-4845-ad3b-c2b9ffc04f67'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.612261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443a525e544f4ff6a96c08039d88471b', 'request_id': 'req-f87610f9-7996-4845-ad3b-c2b9ffc04f67'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.621409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443a525e544f4ff6a96c08039d88471b', 'request_id': 'req-f87610f9-7996-4845-ad3b-c2b9ffc04f67'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.637154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] The token cache is being invalidate because project 443a525e544f4ff6a96c08039d88471b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:18.637154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.637939 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.644958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1155/2278] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:18 2022] DELETE /identity/v3/projects/443a525e544f4ff6a96c08039d88471b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:20:18.646323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:18.665572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c3037-148d-4a50-b6a6-627a06ac1a85 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:18.680622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:18.786671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:18.787617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:18.788090 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:18.788378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] PATH_INFO: `/v3/users/0e2672cb1e8e4ab3a8d5c650da2f9a68` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:18.790173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2672cb1e8e4ab3a8d5c650da2f9a68)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:18.792573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:18.882748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2672cb1e8e4ab3a8d5c650da2f9a68'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.893780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2672cb1e8e4ab3a8d5c650da2f9a68'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.911535 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2672cb1e8e4ab3a8d5c650da2f9a68'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.912390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2672cb1e8e4ab3a8d5c650da2f9a68'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.923377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2672cb1e8e4ab3a8d5c650da2f9a68'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:18.932527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1124/2279] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:18 2022] DELETE /identity/v3/users/0e2672cb1e8e4ab3a8d5c650da2f9a68 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:19.508627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:19.519403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:19.558946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87610f9-7996-4845-ad3b-c2b9ffc04f67 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:19.582619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:19.672687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:19.679332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:19.679332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:19.679332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] PATH_INFO: `/v3/projects/c45c442f939f4e1590032989a7703167` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:19.679332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45c442f939f4e1590032989a7703167)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:19.679332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:19.732266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45c442f939f4e1590032989a7703167', 'request_id': 'req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:19.741773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45c442f939f4e1590032989a7703167', 'request_id': 'req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:19.756603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45c442f939f4e1590032989a7703167', 'request_id': 'req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:19.770622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] The token cache is being invalidate because project c45c442f939f4e1590032989a7703167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:19.771412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:19.772398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b4d17d1a-a6ed-4ddb-a15f-4b6eb126b97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:19.778689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:19.780902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:19.783141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1156/2280] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:19 2022] DELETE /identity/v3/projects/c45c442f939f4e1590032989a7703167 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:19.796453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16d7c-efe1-407f-b4d5-5f3c85789d16 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:19.863308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:19.864608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:19.865073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:19.865520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] PATH_INFO: `/v3/users/c063b7b343eb45eea2fab962113bc51b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:19.867174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c063b7b343eb45eea2fab962113bc51b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:19.869337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:19.921887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:19.964821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c063b7b343eb45eea2fab962113bc51b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:19.975869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c063b7b343eb45eea2fab962113bc51b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.004575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c063b7b343eb45eea2fab962113bc51b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.005108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c063b7b343eb45eea2fab962113bc51b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.013171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c063b7b343eb45eea2fab962113bc51b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.019633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1125/2281] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:19 2022] DELETE /identity/v3/users/c063b7b343eb45eea2fab962113bc51b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:20.232337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459bf4-ff65-43e5-a9d5-2651b73d2e42 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:20.232802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459bf4-ff65-43e5-a9d5-2651b73d2e42 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:20.233740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5459bf4-ff65-43e5-a9d5-2651b73d2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:20.257902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f5459bf4-ff65-43e5-a9d5-2651b73d2e42 None None] MFA Rules not processed for user `ea0ef27b984c4b829edc0ac0d785021b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:20.259165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f5459bf4-ff65-43e5-a9d5-2651b73d2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:20.340187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1157/2282] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:20.451611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:20.453887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:20.672225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414d5a7-ac9e-4171-a548-86058080b539 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:20.685338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:20.686238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:20.686527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:20.687977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] PATH_INFO: `/v3/projects/1d7f3289efc74ad2bb1ef76be758e2ba` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:20.689936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7f3289efc74ad2bb1ef76be758e2ba)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:20.693206 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:20.769878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7f3289efc74ad2bb1ef76be758e2ba', 'request_id': 'req-37d62186-f611-4499-b3b7-47ef9e2c864c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.795578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7f3289efc74ad2bb1ef76be758e2ba', 'request_id': 'req-37d62186-f611-4499-b3b7-47ef9e2c864c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.803663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7f3289efc74ad2bb1ef76be758e2ba', 'request_id': 'req-37d62186-f611-4499-b3b7-47ef9e2c864c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.817683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] The token cache is being invalidate because project 1d7f3289efc74ad2bb1ef76be758e2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:20.818104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.818903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d62186-f611-4499-b3b7-47ef9e2c864c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:20.826651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1126/2283] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:20 2022] DELETE /identity/v3/projects/1d7f3289efc74ad2bb1ef76be758e2ba => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:20.827884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:20.828919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:20.830020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:20.856330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:20.858036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:20.920696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:20.973574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1158/2284] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:20.981652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:20.981956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:20.982245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.030386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:21.036726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:21.072658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1127/2285] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:21.076421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:21.099739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2674b4-676f-46a4-9a05-4ffc1ac8f676 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:21.107708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:21.108502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.108919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.109830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.110737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:20:21.111217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:21.127854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:21.181685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:21.191016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1159/2286] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:20:21.194389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cf903-5b74-4598-ada5-681a2c1e10c3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:21.212737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:21.214316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.215741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.217112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.222078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:21.224348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:21.337836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1128/2287] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:20:21 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:20:21.339956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:21.378169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160d80a-4fac-4219-b7de-de8201325d21 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:21.616177 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:21.616882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.617223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.617504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.627240 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:21.629472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:21.677812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1160/2288] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:20:21 2022] POST /identity/v3/users => generated 292 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:20:21.680359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:21.698017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436fc81-9721-4cc7-b573-55cb051dfd28 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:21.709333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:21.710132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.710528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.710913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.711820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:21.714273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:21.721303 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:21.751187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1129/2289] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:21.753795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:21.771616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29e7da-5317-43e5-86a2-f6dfa46763a2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:21.785869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cefa9a-e0d9-42b2-8e95-475eb03306db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:21.786584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cefa9a-e0d9-42b2-8e95-475eb03306db admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.786885 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cefa9a-e0d9-42b2-8e95-475eb03306db admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.787202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cefa9a-e0d9-42b2-8e95-475eb03306db admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.787953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cefa9a-e0d9-42b2-8e95-475eb03306db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:21.789603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cefa9a-e0d9-42b2-8e95-475eb03306db admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:21.828162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1161/2290] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:20:21.833637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:21.852145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893cfef-9a9a-46a3-8c91-f31afd57490b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:21.862526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:21.863829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.864340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.864731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] PATH_INFO: `/v3/projects/6561ab4d7cc94d00a4658bbd1ccbba76/users/1156521998d24e84b6485d5620198389/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:21.886383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6561ab4d7cc94d00a4658bbd1ccbba76, user_id=1156521998d24e84b6485d5620198389, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:21.889914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:21.919962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1130/2291] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:20:21 2022] PUT /identity/v3/projects/6561ab4d7cc94d00a4658bbd1ccbba76/users/1156521998d24e84b6485d5620198389/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:21.925643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d91ac-b4e8-4e30-981c-7dee5df443b1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:21.926125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d91ac-b4e8-4e30-981c-7dee5df443b1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:21.926407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d91ac-b4e8-4e30-981c-7dee5df443b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:22.004715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-781d91ac-b4e8-4e30-981c-7dee5df443b1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:22.006138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-781d91ac-b4e8-4e30-981c-7dee5df443b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:22.241112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1162/2292] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:22.289582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:22.291602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:22.462957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143c2b2-825a-4edc-8150-509f47e9040f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:22.475889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:22.477950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:22.480248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:22.480624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:22.514934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:22.518812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:22.546264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1131/2293] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:23.973400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3a8f-b753-476d-9430-889d3ad5218a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:23.973904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3a8f-b753-476d-9430-889d3ad5218a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:23.974018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3a8f-b753-476d-9430-889d3ad5218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:24.037812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-dd7a3a8f-b753-476d-9430-889d3ad5218a None None] MFA Rules not processed for user `1156521998d24e84b6485d5620198389`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:24.039573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dd7a3a8f-b753-476d-9430-889d3ad5218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:24.141611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:24.205957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1163/2294] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:24.211151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:24.212634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:24.310940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da183f0-cec5-4e49-ba05-c279924f12f5 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:24.316456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092a36a-dc40-48b1-9f73-7b9f42bffeb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:24.317897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092a36a-dc40-48b1-9f73-7b9f42bffeb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:24.318253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092a36a-dc40-48b1-9f73-7b9f42bffeb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:24.318549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092a36a-dc40-48b1-9f73-7b9f42bffeb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:24.335867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092a36a-dc40-48b1-9f73-7b9f42bffeb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:24.342238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092a36a-dc40-48b1-9f73-7b9f42bffeb4 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:24.364503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1132/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:25.933448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def495d-2721-454f-87af-97a80f9e0df0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:25.933992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def495d-2721-454f-87af-97a80f9e0df0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:25.933992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def495d-2721-454f-87af-97a80f9e0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:25.953095 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0def495d-2721-454f-87af-97a80f9e0df0 None None] MFA Rules not processed for user `1156521998d24e84b6485d5620198389`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:25.954849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0def495d-2721-454f-87af-97a80f9e0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:25.961983 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1164/2296] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:32.894993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c02c-3442-49c9-b882-af48bb335f38 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:32.894993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c02c-3442-49c9-b882-af48bb335f38 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:32.894993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c02c-3442-49c9-b882-af48bb335f38 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:32.896386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1133/2297] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:20:32.902437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b47f6b-f5ca-49bf-b08b-e2b6079a6ae3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:32.902910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b47f6b-f5ca-49bf-b08b-e2b6079a6ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:32.903059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b47f6b-f5ca-49bf-b08b-e2b6079a6ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:32.983832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-89b47f6b-f5ca-49bf-b08b-e2b6079a6ae3 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:32.985168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-89b47f6b-f5ca-49bf-b08b-e2b6079a6ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:33.077937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1165/2298] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:20:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:33.090584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454c02c-3442-49c9-b882-af48bb335f38 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:33.092338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f454c02c-3442-49c9-b882-af48bb335f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:33.157265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454c02c-3442-49c9-b882-af48bb335f38 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:33.161712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0278fae-c8a6-4750-b2b4-39a8514d7b72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:33.162468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0278fae-c8a6-4750-b2b4-39a8514d7b72 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.162834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0278fae-c8a6-4750-b2b4-39a8514d7b72 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.163245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0278fae-c8a6-4750-b2b4-39a8514d7b72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.174809 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0278fae-c8a6-4750-b2b4-39a8514d7b72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:33.176287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0278fae-c8a6-4750-b2b4-39a8514d7b72 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:33.188650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1134/2299] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:33.267200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa57ce-957f-465d-a58b-f77b113705b9 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.268032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa57ce-957f-465d-a58b-f77b113705b9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.268846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa57ce-957f-465d-a58b-f77b113705b9 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.270566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1166/2300] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:20:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:20:33.280584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7d5c-bcb0-436d-b3df-b27821849ce5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.280897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7d5c-bcb0-436d-b3df-b27821849ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.281187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7d5c-bcb0-436d-b3df-b27821849ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.307387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b9da7d5c-bcb0-436d-b3df-b27821849ce5 None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:33.308629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b9da7d5c-bcb0-436d-b3df-b27821849ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:33.318986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1135/2301] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:20:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:33.341741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa57ce-957f-465d-a58b-f77b113705b9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:33.353726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa57ce-957f-465d-a58b-f77b113705b9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:33.358019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d1734-8af1-460b-baba-6cf3aa0e5368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:33.358672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1734-8af1-460b-baba-6cf3aa0e5368 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.358961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1734-8af1-460b-baba-6cf3aa0e5368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.359277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d1734-8af1-460b-baba-6cf3aa0e5368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.367690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1734-8af1-460b-baba-6cf3aa0e5368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:33.369281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d1734-8af1-460b-baba-6cf3aa0e5368 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:33.378122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1167/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:33.505671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb1f24-d21b-4a94-b794-aa8aa86d4207 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.505969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb1f24-d21b-4a94-b794-aa8aa86d4207 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.506254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb1f24-d21b-4a94-b794-aa8aa86d4207 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.508529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1136/2303] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:20:33.514137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827a15-720f-48bd-b4ad-c7478a9037b7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.514491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827a15-720f-48bd-b4ad-c7478a9037b7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.514780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827a15-720f-48bd-b4ad-c7478a9037b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.535812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9a827a15-720f-48bd-b4ad-c7478a9037b7 None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:33.537091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9a827a15-720f-48bd-b4ad-c7478a9037b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:33.548728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1168/2304] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:20:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:33.559244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb1f24-d21b-4a94-b794-aa8aa86d4207 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:33.572328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb1f24-d21b-4a94-b794-aa8aa86d4207 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:33.576081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:33.576735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:33.577022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:33.577304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:33.589149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:33.590595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:33.597456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:33.603631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1137/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:42.336109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ddd2f-c6ac-4637-a356-af6b6127af6d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:42.336608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ddd2f-c6ac-4637-a356-af6b6127af6d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:42.336724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ddd2f-c6ac-4637-a356-af6b6127af6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:42.356260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-464ddd2f-c6ac-4637-a356-af6b6127af6d None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:42.357537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-464ddd2f-c6ac-4637-a356-af6b6127af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:42.414261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:42.427225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1169/2306] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:42.452394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:42.454268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:42.503798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:42.505109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:42.505109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:42.524333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:42.525839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:42.531893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923c8eb-7dde-445c-b49e-a1f4fef3710c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:42.534371 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1170/2307] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:20:42.541853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:42.542607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:42.542895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:42.543207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:42.549783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:42.553196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:42.554906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:42.564028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1138/2308] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:20:42.564805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93a6b9-64e1-4535-b1da-9bf386efc132 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:42.571496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c8a7f-95bd-4f6f-8727-c04f89da909a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:42.572167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c8a7f-95bd-4f6f-8727-c04f89da909a service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:42.572459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c8a7f-95bd-4f6f-8727-c04f89da909a service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:42.572743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c8a7f-95bd-4f6f-8727-c04f89da909a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:42.581690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c8a7f-95bd-4f6f-8727-c04f89da909a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:42.583359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c8a7f-95bd-4f6f-8727-c04f89da909a service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:42.592330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1171/2309] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:20:42.783529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:42.785908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:42.811783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adf0e2-2946-4527-a075-384ba95606ea service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:42.819674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:42.821350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:42.821902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:42.822641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] PATH_INFO: `/v3/users/e62fa89a21954fb3a90a9441112a9c55` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:42.824378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62fa89a21954fb3a90a9441112a9c55)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:42.827409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:42.905407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62fa89a21954fb3a90a9441112a9c55'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:42.924160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62fa89a21954fb3a90a9441112a9c55'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:42.947534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62fa89a21954fb3a90a9441112a9c55'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:42.948849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62fa89a21954fb3a90a9441112a9c55'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:42.969182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62fa89a21954fb3a90a9441112a9c55'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:43.006680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:43.007088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:43.007364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:43.009532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1139/2310] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:42 2022] DELETE /identity/v3/users/e62fa89a21954fb3a90a9441112a9c55 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:43.037337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:43.040393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:43.173362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1172/2311] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:43.182661 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:43.184347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:43.296483 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116a4c-0ed8-4d2a-b9b6-f9e2113e684a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:43.307386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2854e-8fe5-459f-8b9a-d3050b66d08c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:43.308062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2854e-8fe5-459f-8b9a-d3050b66d08c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:43.308350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2854e-8fe5-459f-8b9a-d3050b66d08c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:43.308686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2854e-8fe5-459f-8b9a-d3050b66d08c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:43.320054 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2854e-8fe5-459f-8b9a-d3050b66d08c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:43.321641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2854e-8fe5-459f-8b9a-d3050b66d08c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:43.349294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1140/2312] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:43.679879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:43.682405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:43.728785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210669-07d1-41e9-9463-ecce73414562 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:43.735109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:43.736210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:43.736469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:43.736822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] PATH_INFO: `/v3/projects/ffe6616582494833b929111db26dbaf1` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:43.739934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe6616582494833b929111db26dbaf1)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:43.745010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:43.812798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe6616582494833b929111db26dbaf1', 'request_id': 'req-f68d1a01-cf2a-482f-85a0-14b55aa2c091'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:43.842913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe6616582494833b929111db26dbaf1', 'request_id': 'req-f68d1a01-cf2a-482f-85a0-14b55aa2c091'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:43.851602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe6616582494833b929111db26dbaf1', 'request_id': 'req-f68d1a01-cf2a-482f-85a0-14b55aa2c091'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:43.866415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] The token cache is being invalidate because project ffe6616582494833b929111db26dbaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:43.866807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:43.867727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:43.869422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1173/2313] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:43 2022] DELETE /identity/v3/projects/ffe6616582494833b929111db26dbaf1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:52.996862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f527f-e6ad-4917-88ed-24f9a458ec6e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:52.997438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f527f-e6ad-4917-88ed-24f9a458ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:52.997438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f527f-e6ad-4917-88ed-24f9a458ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:53.004641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:53.016887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-083f527f-e6ad-4917-88ed-24f9a458ec6e None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:53.018100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-083f527f-e6ad-4917-88ed-24f9a458ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:53.075433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1141/2314] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jun 29 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:20:53.088235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:53.089617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:53.154193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:53.161623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d1a01-cf2a-482f-85a0-14b55aa2c091 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:53.167964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:53.168617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:53.168905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:53.169239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:53.177247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:53.179473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:53.187743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1174/2315] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:20:53.398895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79324-91bf-432d-9fe1-c6f5b8e2cc04 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:53.399243 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79324-91bf-432d-9fe1-c6f5b8e2cc04 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:53.399531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f79324-91bf-432d-9fe1-c6f5b8e2cc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:53.417735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b1f79324-91bf-432d-9fe1-c6f5b8e2cc04 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:53.418943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b1f79324-91bf-432d-9fe1-c6f5b8e2cc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:53.425990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1142/2316] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:53.438315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:53.449166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c477f76-40d5-44ed-ac93-de38e8a45692 service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:53.454182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:53.454816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:53.455146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:53.455429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:53.464381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:53.465977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:53.475308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1175/2317] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:20:53.798369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:53.798666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:53.798950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:53.816886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:53.818646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:53.825865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1143/2318] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jun 29 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:53.838249 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:53.853141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674ea27-1359-4747-970e-c3086f970cec service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:53.859784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd680bd-8d2e-4068-8ef3-0fa5d42377b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:53.860541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd680bd-8d2e-4068-8ef3-0fa5d42377b3 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:53.860901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd680bd-8d2e-4068-8ef3-0fa5d42377b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:53.861250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd680bd-8d2e-4068-8ef3-0fa5d42377b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:53.870543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd680bd-8d2e-4068-8ef3-0fa5d42377b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:53.872435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd680bd-8d2e-4068-8ef3-0fa5d42377b3 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:53.886837 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1176/2319] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:20:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:20:55.961730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:55.963253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:56.034291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99906cd8-2773-4842-bf38-9c6ece30b18e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:56.039905 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:56.040773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:56.041058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:56.041336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] PATH_INFO: `/v3/users/ea0ef27b984c4b829edc0ac0d785021b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:56.042536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea0ef27b984c4b829edc0ac0d785021b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:56.044532 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:56.090385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea0ef27b984c4b829edc0ac0d785021b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.097496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea0ef27b984c4b829edc0ac0d785021b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.109494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea0ef27b984c4b829edc0ac0d785021b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.110126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea0ef27b984c4b829edc0ac0d785021b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.117043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea0ef27b984c4b829edc0ac0d785021b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.122974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1144/2320] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:20:55 2022] DELETE /identity/v3/users/ea0ef27b984c4b829edc0ac0d785021b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:20:56.127760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:56.128382 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:56.128540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:56.147415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:20:56.148612 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:56.207858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1177/2321] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:20:56.217939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:56.219364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:56.245142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:20:56.285178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2a3df-f1f1-447a-a084-051b4d5ecf0e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:56.288951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:56.289620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:56.289895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:56.290180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:56.299528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:56.300967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:56.310771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1145/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:56.390609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:56.392049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:56.484593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7226-be04-46a6-8bb3-1ca33a7bbfa2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:56.490909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:56.491628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:56.491913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:56.492193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:20:56.492327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:56.493689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:56.494119 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:20:56.507580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12cabf-90d1-44f5-bf03-ce028a5d568b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:20:56.507675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:56.509251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030142c-f961-4dcf-8866-89e0ef441bb0 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:56.513104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:20:56.513990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:20:56.514470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:20:56.514788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] PATH_INFO: `/v3/projects/ceaadedb270447d0954e6876296fa052` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:20:56.516130 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceaadedb270447d0954e6876296fa052)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:20:56.519336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:20:56.521155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1178/2323] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:20:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:20:56.571918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceaadedb270447d0954e6876296fa052', 'request_id': 'req-51867820-4c61-4a85-b55b-d69ffee38fcd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.579107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceaadedb270447d0954e6876296fa052', 'request_id': 'req-51867820-4c61-4a85-b55b-d69ffee38fcd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.585496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceaadedb270447d0954e6876296fa052', 'request_id': 'req-51867820-4c61-4a85-b55b-d69ffee38fcd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.595812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] The token cache is being invalidate because project ceaadedb270447d0954e6876296fa052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:20:56.596104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.596742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:20:56.598276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1146/2324] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:20:56 2022] DELETE /identity/v3/projects/ceaadedb270447d0954e6876296fa052 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:21:02.152080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e251c-f9f8-4049-8d27-542402fb8137 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:02.152579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e251c-f9f8-4049-8d27-542402fb8137 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:02.152680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e251c-f9f8-4049-8d27-542402fb8137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:02.201369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ff4e251c-f9f8-4049-8d27-542402fb8137 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:02.202558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ff4e251c-f9f8-4049-8d27-542402fb8137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:02.206731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:21:02.272013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1179/2325] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jun 29 11:21:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:21:02.284572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:02.285995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:02.378192 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51867820-4c61-4a85-b55b-d69ffee38fcd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:02.383195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:02.383858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:02.384127 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:02.384404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:02.392405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:02.393977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:02.402007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1147/2326] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:21:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:21:03.268143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d827-e4e5-4c72-b1df-3a0b5cdd13fa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:03.268660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d827-e4e5-4c72-b1df-3a0b5cdd13fa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:03.268660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d827-e4e5-4c72-b1df-3a0b5cdd13fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:03.286743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aa82d827-e4e5-4c72-b1df-3a0b5cdd13fa None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:03.288553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aa82d827-e4e5-4c72-b1df-3a0b5cdd13fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:03.345595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1180/2327] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:03.366405 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:03.367969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:03.384491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:21:03.450118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533ca31-76bf-4c0d-991e-fab491a07449 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:03.455460 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:03.456103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:03.456387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:03.456667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:03.465577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:03.467248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:03.477282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1148/2328] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:21:07.323947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440eb6a-0ea8-4f84-af24-ad6758e7db61 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:07.324470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440eb6a-0ea8-4f84-af24-ad6758e7db61 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:07.324567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440eb6a-0ea8-4f84-af24-ad6758e7db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:07.342415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c440eb6a-0ea8-4f84-af24-ad6758e7db61 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:07.343634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c440eb6a-0ea8-4f84-af24-ad6758e7db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:07.352195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1181/2329] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:07.387602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:07.389017 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:07.403208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c2803-5474-403c-a46e-08269be8c71a service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:07.408679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:07.409305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:07.409587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:07.409865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:07.418389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:07.419978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:07.430086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1149/2330] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:21:10.629437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bbe7b-f7d6-4216-a006-f45d3e7985ca None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:10.630003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bbe7b-f7d6-4216-a006-f45d3e7985ca None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:10.630116 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bbe7b-f7d6-4216-a006-f45d3e7985ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:10.650220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-357bbe7b-f7d6-4216-a006-f45d3e7985ca None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:10.651465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-357bbe7b-f7d6-4216-a006-f45d3e7985ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:10.659369 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1182/2331] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:10.697088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:10.708312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc396b0-2039-4ea1-9af8-c53ff629c56a service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:10.713797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:10.714429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:10.714719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:10.715004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:10.723353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:10.724948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:10.735237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1150/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:21:13.705994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12ff8-afbd-4d9a-9560-8bacfe0c6363 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:13.706506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12ff8-afbd-4d9a-9560-8bacfe0c6363 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:13.706702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de12ff8-afbd-4d9a-9560-8bacfe0c6363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:13.724805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4de12ff8-afbd-4d9a-9560-8bacfe0c6363 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:13.726571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4de12ff8-afbd-4d9a-9560-8bacfe0c6363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:13.739073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1183/2333] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:13.761302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:13.772468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b45b-ec23-44f1-a32a-804f20c108e6 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:13.778004 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:13.778711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:13.779097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:13.779466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:13.788456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:13.790119 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:13.799928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1151/2334] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:21:18.955504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804e78-28ef-4993-aaf2-31f1d650303c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:18.956432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804e78-28ef-4993-aaf2-31f1d650303c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:18.956935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88804e78-28ef-4993-aaf2-31f1d650303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:19.004187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-88804e78-28ef-4993-aaf2-31f1d650303c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:19.005670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-88804e78-28ef-4993-aaf2-31f1d650303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:19.018908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1184/2335] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:19.043247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:19.059271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619b97b-27be-4586-b06b-7de597c35387 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:19.068917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77572e-21a3-4773-9e3a-e07d15d91ff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:19.069562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77572e-21a3-4773-9e3a-e07d15d91ff7 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:19.069849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77572e-21a3-4773-9e3a-e07d15d91ff7 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:19.070357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77572e-21a3-4773-9e3a-e07d15d91ff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:19.079334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77572e-21a3-4773-9e3a-e07d15d91ff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:19.080925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77572e-21a3-4773-9e3a-e07d15d91ff7 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:19.091631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1152/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:21:23.141745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:23.142306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:23.142306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:23.160777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:23.161968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:23.171337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1185/2337] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:23.202112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eb398-edcd-46d7-a20a-0c258806cade None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:23.202650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eb398-edcd-46d7-a20a-0c258806cade None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:23.202650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eb398-edcd-46d7-a20a-0c258806cade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:23.220687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fc9eb398-edcd-46d7-a20a-0c258806cade None None] MFA Rules not processed for user `acee9273e0714017bb29bbc578847b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:23.221883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fc9eb398-edcd-46d7-a20a-0c258806cade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:23.230426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:23.243181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d3825-3f30-4417-89f7-cc38dd591a61 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:23.248741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed38ab5-4657-4c4f-9b6f-a5f109db7ce3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:23.249388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38ab5-4657-4c4f-9b6f-a5f109db7ce3 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:23.249679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38ab5-4657-4c4f-9b6f-a5f109db7ce3 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:23.249970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38ab5-4657-4c4f-9b6f-a5f109db7ce3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:23.258919 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38ab5-4657-4c4f-9b6f-a5f109db7ce3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:23.260545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38ab5-4657-4c4f-9b6f-a5f109db7ce3 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:23.270060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1186/2338] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:21:23.277651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1153/2339] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:21:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:33.265932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=73 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:21:33.271533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=78 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:21:39.581137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd84d-b1c1-4700-9a26-e1cfc2e55bc3 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:39.581634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd84d-b1c1-4700-9a26-e1cfc2e55bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:39.581741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadd84d-b1c1-4700-9a26-e1cfc2e55bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:39.600039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-adadd84d-b1c1-4700-9a26-e1cfc2e55bc3 None None] MFA Rules not processed for user `1156521998d24e84b6485d5620198389`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:39.601213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-adadd84d-b1c1-4700-9a26-e1cfc2e55bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:39.655938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1187/2340] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:48.115876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:48.116448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:48.116448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:48.134938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] MFA Rules not processed for user `eb03b2aff9674231b7275a12171a3197`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:48.147381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:48.198674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1154/2341] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:21:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:49.649365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=25 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:21:58.192026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=25 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:21:59.013140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510d1c-7408-45e0-ad01-f99d83fc7883 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:59.013630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510d1c-7408-45e0-ad01-f99d83fc7883 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:59.013630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510d1c-7408-45e0-ad01-f99d83fc7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:59.032734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3b510d1c-7408-45e0-ad01-f99d83fc7883 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:59.033936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3b510d1c-7408-45e0-ad01-f99d83fc7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:59.042792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1188/2342] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:21:59.066339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:21:59.079551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0b7ef-c25d-4797-9355-f2dcf0fbfdfe None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:21:59.085070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81882fdf-d425-41b4-87f3-ac82d7a6f074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:21:59.085814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882fdf-d425-41b4-87f3-ac82d7a6f074 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:59.086308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882fdf-d425-41b4-87f3-ac82d7a6f074 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:59.086588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81882fdf-d425-41b4-87f3-ac82d7a6f074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:59.095385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882fdf-d425-41b4-87f3-ac82d7a6f074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:21:59.097095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81882fdf-d425-41b4-87f3-ac82d7a6f074 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:21:59.107440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1155/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:21:59.781161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:21:59.781457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:21:59.781740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:21:59.799026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] MFA Rules not processed for user `2ab3cbf49f514ba0bc7cf2e387f4933f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:21:59.800232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:21:59.854704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1189/2344] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:02.299250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687870-cd92-4eb2-96fc-64ad9461b971 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:02.299783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687870-cd92-4eb2-96fc-64ad9461b971 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:02.299995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22687870-cd92-4eb2-96fc-64ad9461b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:02.318507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-22687870-cd92-4eb2-96fc-64ad9461b971 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:22:02.319769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-22687870-cd92-4eb2-96fc-64ad9461b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:02.327699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1156/2345] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:02.348161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:02.364060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a522563-d93c-43e3-bb64-2adf04008bec None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:02.371622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:02.372400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:02.372807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:02.373185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:02.384045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:02.385674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:02.398935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1190/2346] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:22:05.340988 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ea27-d1a8-48db-ad46-6f03f8aa2ddb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:05.341477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ea27-d1a8-48db-ad46-6f03f8aa2ddb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:05.341577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ea27-d1a8-48db-ad46-6f03f8aa2ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:05.358886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bfc0ea27-d1a8-48db-ad46-6f03f8aa2ddb None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:22:05.360101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bfc0ea27-d1a8-48db-ad46-6f03f8aa2ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:05.367741 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1157/2347] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:05.399235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:05.410280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b1c13-901f-4a7d-b6ba-5965c3ad2de7 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:05.415764 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:05.416401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:05.416716 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:05.416998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:05.425058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:05.426645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:05.436878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1191/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:22:09.536921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5eb39-86ba-4b21-a4fb-fc9e6ded1233 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:09.537427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5eb39-86ba-4b21-a4fb-fc9e6ded1233 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:09.537549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5eb39-86ba-4b21-a4fb-fc9e6ded1233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:09.556311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8ef5eb39-86ba-4b21-a4fb-fc9e6ded1233 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:22:09.558157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8ef5eb39-86ba-4b21-a4fb-fc9e6ded1233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:09.566510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1158/2349] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:09.615312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:09.627408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae838f-8339-4bcc-a7a4-1518ac8f917e service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:09.633088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:09.633830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:09.634180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:09.634630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:09.643952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:09.645792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:09.656798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1192/2350] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:22:12.699748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057acea-09da-4772-bd07-01d31d06dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:12.700254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057acea-09da-4772-bd07-01d31d06dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:12.700363 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057acea-09da-4772-bd07-01d31d06dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:12.718279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2057acea-09da-4772-bd07-01d31d06dfb1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:22:12.719498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2057acea-09da-4772-bd07-01d31d06dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:12.727321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1159/2351] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Jun 29 11:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:12.752377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:12.763862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af0f17-3c37-4a03-87f3-c8e08ea4be0d service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:12.769373 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ccd5b-ab3b-4038-bd37-fb8ad4dd2707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:12.770015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ccd5b-ab3b-4038-bd37-fb8ad4dd2707 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:12.770306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ccd5b-ab3b-4038-bd37-fb8ad4dd2707 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:12.770588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ccd5b-ab3b-4038-bd37-fb8ad4dd2707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:12.779349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ccd5b-ab3b-4038-bd37-fb8ad4dd2707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:12.781004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ccd5b-ab3b-4038-bd37-fb8ad4dd2707 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:12.791072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1193/2352] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:22:22.713228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=18 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:22.786603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=52 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:32.317833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:32.318397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:32.318397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:32.337475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] MFA Rules not processed for user `fb03aabb4dfe4e17bf12831cc5824612`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:22:32.339188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:32.402018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1160/2353] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:22:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:41.470482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:41.471109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:41.471109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:41.489359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] MFA Rules not processed for user `acee9273e0714017bb29bbc578847b53`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:22:41.490569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:41.498153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1194/2354] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:22:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:22:42.391449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=25 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:42.908036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:42.909509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:42.924105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec69b1-8efb-4a70-a51c-ba597711f234 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:42.928837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:42.929728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:42.930009 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:42.930284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] PATH_INFO: `/v3/users/1156521998d24e84b6485d5620198389` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:42.931525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1156521998d24e84b6485d5620198389)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:42.933526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:42.987065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1156521998d24e84b6485d5620198389'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:42.996816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1156521998d24e84b6485d5620198389'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.010785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1156521998d24e84b6485d5620198389'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.011549 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1156521998d24e84b6485d5620198389'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.020394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1156521998d24e84b6485d5620198389'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.027881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1161/2355] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:22:42 2022] DELETE /identity/v3/users/1156521998d24e84b6485d5620198389 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:22:43.215797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:43.236893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067beb19-5e27-4c83-b160-91c5d309772a None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:43.304677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:43.305549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:43.305842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:43.306122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] PATH_INFO: `/v3/projects/6561ab4d7cc94d00a4658bbd1ccbba76` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:43.307763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6561ab4d7cc94d00a4658bbd1ccbba76)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:43.309674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:43.356488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6561ab4d7cc94d00a4658bbd1ccbba76', 'request_id': 'req-47f86580-9754-4cdb-bdc1-dd166c6146d5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.364004 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6561ab4d7cc94d00a4658bbd1ccbba76', 'request_id': 'req-47f86580-9754-4cdb-bdc1-dd166c6146d5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.370265 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6561ab4d7cc94d00a4658bbd1ccbba76', 'request_id': 'req-47f86580-9754-4cdb-bdc1-dd166c6146d5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.380392 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] The token cache is being invalidate because project 6561ab4d7cc94d00a4658bbd1ccbba76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:22:43.380775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.381417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:22:43.383091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1195/2356] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:22:43 2022] DELETE /identity/v3/projects/6561ab4d7cc94d00a4658bbd1ccbba76 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:22:46.653565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:46.655260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:46.736858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc1b0a-ab79-4e79-9d50-e2e911e8d834 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:46.809955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:46.810692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:46.811315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:46.811601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:46.813418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:46.858517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:46.891705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:46.893164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:46.904749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1162/2357] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:22:53.377393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:55.544340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:55.545887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:55.558294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f86580-9754-4cdb-bdc1-dd166c6146d5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:22:55.562221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:22:55.562871 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:22:55.563206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:22:55.563501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:22:55.565236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:22:55.578968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:22:55.580673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:22:55.594454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1196/2358] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:22:56.899518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=14 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:22:59.995834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:22:59.997230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:00.011468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9cd15-c497-4fe9-8f80-072011e7e64c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:00.013992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:00.015501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:00.017201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:00.017847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:00.018140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:00.018512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:00.020375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:00.027272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e47de-c6cd-4a31-9186-fb36d680d0ec service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:00.030984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:00.031669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:00.031965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:00.032251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:00.034197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:00.087502 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:00.089145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:00.099527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1163/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:22:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:00.111936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:00.113395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:00.123980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1197/2360] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:02.618321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:02.627780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edf74f-7d50-4b77-9d47-b9b74daecc96 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:02.631489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:02.632126 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:02.632411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:02.632689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:02.635000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:02.696179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:02.698106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:02.707728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1164/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:06.017682 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.019223 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:06.032869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7531bbb0-fad0-446d-8749-cd3158fc5a70 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.037333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.038202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.038493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.038776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] PATH_INFO: `/v3/users/eb03b2aff9674231b7275a12171a3197` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.039987 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb03b2aff9674231b7275a12171a3197)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.041931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.089856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb03b2aff9674231b7275a12171a3197'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.099005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb03b2aff9674231b7275a12171a3197'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.099866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb03b2aff9674231b7275a12171a3197'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.113778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb03b2aff9674231b7275a12171a3197'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.114410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8e56ffc5-996f-4a68-a555-6dac59888c04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb03b2aff9674231b7275a12171a3197'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.127671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1198/2362] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:06 2022] DELETE /identity/v3/users/eb03b2aff9674231b7275a12171a3197 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:06.302743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.314091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f9ec2-1c46-43a0-8d5a-a2a4de5e82b6 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.372128 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.372920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.373205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.373488 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] PATH_INFO: `/v3/projects/93a6d11eb9fa425182a7106c78e90bbb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.374647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a6d11eb9fa425182a7106c78e90bbb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.376620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.413233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:06.423534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a6d11eb9fa425182a7106c78e90bbb', 'request_id': 'req-40967d00-6f1e-4c38-bc50-565032b69fdb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.430281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a6d11eb9fa425182a7106c78e90bbb', 'request_id': 'req-40967d00-6f1e-4c38-bc50-565032b69fdb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.436731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a6d11eb9fa425182a7106c78e90bbb', 'request_id': 'req-40967d00-6f1e-4c38-bc50-565032b69fdb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.449458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] The token cache is being invalidate because project 93a6d11eb9fa425182a7106c78e90bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:06.449744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.450374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-40967d00-6f1e-4c38-bc50-565032b69fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:06.452048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1165/2363] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:06 2022] DELETE /identity/v3/projects/93a6d11eb9fa425182a7106c78e90bbb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:06.457064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.457359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.457640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.476438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:06.477624 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:06.527033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:06.537780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1199/2364] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:23:06.545275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.545690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.546001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.564648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:06.565848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:06.574250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1166/2365] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:06.578300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.588193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786444-c008-4d19-90a1-051efcf7342d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.593626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.594534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.594826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.595134 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.595866 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:23:06.596221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.597858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.610736 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1200/2366] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:23:06.614883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.625378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0acc0d-2a81-4fb9-afdb-da1779e1dc7e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.630364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.631165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.631526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.632108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.633612 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.636629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.665803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1167/2367] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:06 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:06.667001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.677046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f2302-4689-4607-882d-2af9b94ecc46 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.735247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.735911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.736195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.736473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.737153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.739087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.758319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1201/2368] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:06 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:23:06.762901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.773166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1916a-c6a4-41be-aae9-7c4edd8f71e5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.777757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.778437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.778721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.778996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.779749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.781337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.791645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1168/2369] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:06.795442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.805118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504339d-7ad4-41da-b2b9-9ad7e88680c3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.810225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2de27-49f6-476e-bfbd-f25841cf8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.811142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2de27-49f6-476e-bfbd-f25841cf8186 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.811443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2de27-49f6-476e-bfbd-f25841cf8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.811720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2de27-49f6-476e-bfbd-f25841cf8186 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.812430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2de27-49f6-476e-bfbd-f25841cf8186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.813997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2de27-49f6-476e-bfbd-f25841cf8186 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.824407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1202/2370] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:06.828662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.839106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7c92d-07aa-4102-9214-8f7e52849553 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:06.843781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:06.844656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.844945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.845228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] PATH_INFO: `/v3/projects/be8ba140efae4402939cecb08c2f77ed/users/51d2d08c546f4c9caca96b83982567b8/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.861424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8ba140efae4402939cecb08c2f77ed, user_id=51d2d08c546f4c9caca96b83982567b8, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:06.864146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:06.877386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1169/2371] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:06 2022] PUT /identity/v3/projects/be8ba140efae4402939cecb08c2f77ed/users/51d2d08c546f4c9caca96b83982567b8/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:06.882358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c5a-55af-48cf-99ca-eafab988bba4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:06.882678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c5a-55af-48cf-99ca-eafab988bba4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:06.882965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08c5a-55af-48cf-99ca-eafab988bba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:06.900787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-37e08c5a-55af-48cf-99ca-eafab988bba4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:06.901992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37e08c5a-55af-48cf-99ca-eafab988bba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:06.962203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1203/2372] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:06.971716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:06.973403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:07.031157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c94a1-650c-405e-8cbc-6819b5f9226f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:07.034760 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:07.035432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:07.035716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:07.035990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:07.045406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:07.046824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:07.056270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1170/2373] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:07.902888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:07.903423 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:07.903544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:07.929214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] MFA Rules not processed for user `51d2d08c546f4c9caca96b83982567b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:07.930424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:07.994358 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:08.008403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1204/2374] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:08.013407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.023018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e654-b74b-47c3-977f-0d7efc7eeafc service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.027679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.028364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.028650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.028930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.029619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.031573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.058425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1171/2375] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:08 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:08.062515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.074462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca307fa-5da3-4944-86c5-343794fffd30 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.130225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.130896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.131221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.131508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.132207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.134128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.154365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1205/2376] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:08 2022] POST /identity/v3/users => generated 309 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:08.157635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.167824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33a1b4-88dc-4fc9-8cc4-39a794d9747d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.172324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.172967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.173250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.173522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.174236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.175850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.186871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1172/2377] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:08.190755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.201140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d927ba8-19d9-4ffb-9f0c-836a06abc5f2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.205714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.206587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.206878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.207197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] PATH_INFO: `/v3/projects/e2e25addcd184da391cb3b8423048c0c/users/6a1718731957450f8c434dd3e9829905/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.221757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e25addcd184da391cb3b8423048c0c, user_id=6a1718731957450f8c434dd3e9829905, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.224444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.236593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1206/2378] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:08 2022] PUT /identity/v3/projects/e2e25addcd184da391cb3b8423048c0c/users/6a1718731957450f8c434dd3e9829905/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:08.240413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.250799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08138d64-e38e-45e0-a55e-623630a34b61 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.283175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:08.316849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.317510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.317794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.318070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.318785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.320398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.331252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1173/2379] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:08.335429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.345584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eb62a-611d-4a38-9df5-b5a6e81210b8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.350417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe9b1-7b89-490c-80e2-b4acc53d35e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.351379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe9b1-7b89-490c-80e2-b4acc53d35e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.351668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe9b1-7b89-490c-80e2-b4acc53d35e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.351948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe9b1-7b89-490c-80e2-b4acc53d35e9 admin admin] PATH_INFO: `/v3/projects/e2e25addcd184da391cb3b8423048c0c/users/6a1718731957450f8c434dd3e9829905/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.354467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfe9b1-7b89-490c-80e2-b4acc53d35e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e25addcd184da391cb3b8423048c0c, user_id=6a1718731957450f8c434dd3e9829905, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.357158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfe9b1-7b89-490c-80e2-b4acc53d35e9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.367575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1207/2380] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:08 2022] PUT /identity/v3/projects/e2e25addcd184da391cb3b8423048c0c/users/6a1718731957450f8c434dd3e9829905/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:08.689719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:08.691722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:08.775634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bc0bd-32ff-4924-968e-f3c6863a4f25 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:08.843788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:08.844507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:08.844797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:08.845080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:08.846938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:08.908921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:08.910850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:08.916647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:08.923397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1174/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:09.053678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:09.054195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:09.054291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:09.086703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] MFA Rules not processed for user `6a1718731957450f8c434dd3e9829905`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:09.088767 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:09.161952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1208/2382] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:10.159256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:10.226055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf54b8-bbf8-479c-a9f4-580d1618d0f3 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:10.231350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:10.232229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:10.232515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:10.232797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] PATH_INFO: `/v3/users/51d2d08c546f4c9caca96b83982567b8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:10.233994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d2d08c546f4c9caca96b83982567b8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:10.235978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:10.288819 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d2d08c546f4c9caca96b83982567b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.296568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d2d08c546f4c9caca96b83982567b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.308430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d2d08c546f4c9caca96b83982567b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.309065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d2d08c546f4c9caca96b83982567b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.316074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d2d08c546f4c9caca96b83982567b8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.321945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1175/2383] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:10 2022] DELETE /identity/v3/users/51d2d08c546f4c9caca96b83982567b8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:10.498467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:10.510117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e3f7-556c-48e4-b61f-dcb01b94d0bf None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:10.541855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:10.570385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:10.571281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:10.571569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:10.572375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] PATH_INFO: `/v3/projects/be8ba140efae4402939cecb08c2f77ed` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:10.573541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8ba140efae4402939cecb08c2f77ed)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:10.575470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:10.621426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8ba140efae4402939cecb08c2f77ed', 'request_id': 'req-5b2bcad0-a972-429b-a2a5-55e67e28511d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.627787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8ba140efae4402939cecb08c2f77ed', 'request_id': 'req-5b2bcad0-a972-429b-a2a5-55e67e28511d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.633963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8ba140efae4402939cecb08c2f77ed', 'request_id': 'req-5b2bcad0-a972-429b-a2a5-55e67e28511d'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.644879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] The token cache is being invalidate because project be8ba140efae4402939cecb08c2f77ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:10.645173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.645827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.647415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1209/2384] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:10 2022] DELETE /identity/v3/projects/be8ba140efae4402939cecb08c2f77ed => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:10.651955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:10.653373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:10.666360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839f139-b32a-44e1-b047-9a70a325f20c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:10.724875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:10.725759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:10.726047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:10.726330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] PATH_INFO: `/v3/users/6a1718731957450f8c434dd3e9829905` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:10.727552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1718731957450f8c434dd3e9829905)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:10.729548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:10.750663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:10.777181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1718731957450f8c434dd3e9829905'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.784228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1718731957450f8c434dd3e9829905'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.796100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1718731957450f8c434dd3e9829905'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.796761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1718731957450f8c434dd3e9829905'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.803618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4a9c6d2b-d2ca-4752-821b-dc0c7ed75f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1718731957450f8c434dd3e9829905'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:10.809496 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1176/2385] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:10 2022] DELETE /identity/v3/users/6a1718731957450f8c434dd3e9829905 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:10.981093 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:10.982638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:11.002424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bcad0-a972-429b-a2a5-55e67e28511d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.060313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.061452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.061733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.062010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] PATH_INFO: `/v3/projects/e2e25addcd184da391cb3b8423048c0c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.063213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e25addcd184da391cb3b8423048c0c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.065149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.110544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e25addcd184da391cb3b8423048c0c', 'request_id': 'req-c506c46b-a90e-4d3b-870d-d23ad3724fc0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:11.117490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e25addcd184da391cb3b8423048c0c', 'request_id': 'req-c506c46b-a90e-4d3b-870d-d23ad3724fc0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:11.124445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e25addcd184da391cb3b8423048c0c', 'request_id': 'req-c506c46b-a90e-4d3b-870d-d23ad3724fc0'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:11.126386 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:11.137133 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] The token cache is being invalidate because project e2e25addcd184da391cb3b8423048c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:11.137439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:11.138303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c506c46b-a90e-4d3b-870d-d23ad3724fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:11.139923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1210/2386] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:10 2022] DELETE /identity/v3/projects/e2e25addcd184da391cb3b8423048c0c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:11.144837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.145123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.145400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.163000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:11.164149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:11.223486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1177/2387] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:23:11.231256 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.231758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.239135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.257745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:11.258938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:11.267790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1211/2388] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:11.272571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.283836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc45248-f5db-475e-834d-a6dcad664a63 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.288442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.289094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.289377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.289649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.290407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:23:11.290775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.292416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.305447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1178/2389] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:23:11.309089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.318914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442f6e7-ec32-4ed3-a728-bc4121f816c4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.324559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.325213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.325498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.325776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.326470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.328548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.354408 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1212/2390] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:11.358692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.368508 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfbb4f-74d1-4a23-895f-bda8ec1b4391 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.424897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.425474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.425756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.426033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.426798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.428655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.453115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1179/2391] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:11.454390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.465311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969512be-1768-4ea3-98a6-c1374c6ec1f8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.469913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.470571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.470860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.471181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.471906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.473487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.484364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1213/2392] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:11.488383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.498920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4455d-b06a-4d59-87c2-414a3458151f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.503574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d3f8c-f153-4582-8592-9be87983414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.504229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d3f8c-f153-4582-8592-9be87983414d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.504519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d3f8c-f153-4582-8592-9be87983414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.504826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d3f8c-f153-4582-8592-9be87983414d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.505552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d3f8c-f153-4582-8592-9be87983414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.507182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d3f8c-f153-4582-8592-9be87983414d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.517002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1180/2393] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:11.521169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.531068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b436de-7e1a-4aab-83bb-76451e671c64 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.535630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.536500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.536788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.537067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] PATH_INFO: `/v3/projects/faa7e0cb6f344b8f982437fec503b4b6/users/05d16ec0d8b34ef5a676d21bc9233eca/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.552012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa7e0cb6f344b8f982437fec503b4b6, user_id=05d16ec0d8b34ef5a676d21bc9233eca, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.554615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.567958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1214/2394] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:11 2022] PUT /identity/v3/projects/faa7e0cb6f344b8f982437fec503b4b6/users/05d16ec0d8b34ef5a676d21bc9233eca/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:11.578969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.579295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.579578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.586281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:11.606411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] MFA Rules not processed for user `05d16ec0d8b34ef5a676d21bc9233eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:11.607653 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:11.684389 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1181/2395] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:11.689109 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.752184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde91d4-3052-4e70-8428-7265426d4b29 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.756904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.757576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.757862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.758139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.758855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.760817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.785461 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1215/2396] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:11.789615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.800912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d5af8-7b9d-44fb-982e-f81d737b0061 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.863334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.863998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.864286 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.864562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.865244 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.867179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.886048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1182/2397] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:11 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:11.889990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.900626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6125a8-6cf4-4d76-8730-5cc5188c3776 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.905228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.905879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.906162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.906441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.907195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.908807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.920618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1216/2398] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:11.924673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.934710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610cced-423a-443e-8376-176e55d780c0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:11.939597 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:11.940465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:11.940761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:11.941044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] PATH_INFO: `/v3/projects/6c002bbfdf8d4915a91d7358e90b50f8/users/ed8073a4a3a74738a8f562fb0a112d88/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:11.960078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c002bbfdf8d4915a91d7358e90b50f8, user_id=ed8073a4a3a74738a8f562fb0a112d88, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:11.963926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:11.976778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1183/2399] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:11 2022] PUT /identity/v3/projects/6c002bbfdf8d4915a91d7358e90b50f8/users/ed8073a4a3a74738a8f562fb0a112d88/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:11.981720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:11.991617 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f4baf-9e32-4ec3-894d-1e3d4d7c6995 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:12.048315 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531f054-5528-43fd-a344-de7304e0180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:12.048989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f054-5528-43fd-a344-de7304e0180a admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:12.049277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f054-5528-43fd-a344-de7304e0180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:12.049557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f054-5528-43fd-a344-de7304e0180a admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:12.050276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531f054-5528-43fd-a344-de7304e0180a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:12.051906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531f054-5528-43fd-a344-de7304e0180a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:12.053897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:12.062867 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1217/2400] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:12.067111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:12.077697 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45d8b-f20c-4486-b612-0e4829b26386 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:12.082219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:12.083123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:12.083406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:12.083679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] PATH_INFO: `/v3/projects/6c002bbfdf8d4915a91d7358e90b50f8/users/ed8073a4a3a74738a8f562fb0a112d88/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:12.085618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c002bbfdf8d4915a91d7358e90b50f8, user_id=ed8073a4a3a74738a8f562fb0a112d88, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:12.088911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:12.098731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1184/2401] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:12 2022] PUT /identity/v3/projects/6c002bbfdf8d4915a91d7358e90b50f8/users/ed8073a4a3a74738a8f562fb0a112d88/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:12.108550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:12.108850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:12.109138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:12.135673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] MFA Rules not processed for user `ed8073a4a3a74738a8f562fb0a112d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:12.136876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:12.204566 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1218/2402] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:12.216167 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:12.217824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:12.268313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:12.297016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c4858-5436-4c92-82c1-580e6485ae8c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:12.300787 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:12.301426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:12.301709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:12.301986 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:12.310825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:12.312545 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:12.322282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1185/2403] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:12.391515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:12.401933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35290c8-6aa0-479d-b23c-f9715bbb6a89 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:12.405477 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578755b-7901-465d-b99f-aa74f719d6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:12.406112 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578755b-7901-465d-b99f-aa74f719d6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:12.406397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578755b-7901-465d-b99f-aa74f719d6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:12.406675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578755b-7901-465d-b99f-aa74f719d6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:12.463884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578755b-7901-465d-b99f-aa74f719d6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:12.465404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578755b-7901-465d-b99f-aa74f719d6f7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:12.474522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1219/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:19.382000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:19.443491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4257c-d399-4b08-8e1b-3d8703d6dd94 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:19.447964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:19.448828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:19.449111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:19.449995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] PATH_INFO: `/v3/users/05d16ec0d8b34ef5a676d21bc9233eca` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:19.451210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d16ec0d8b34ef5a676d21bc9233eca)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:19.453132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:19.498261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d16ec0d8b34ef5a676d21bc9233eca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:19.505724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d16ec0d8b34ef5a676d21bc9233eca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:19.518372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d16ec0d8b34ef5a676d21bc9233eca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:19.519346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d16ec0d8b34ef5a676d21bc9233eca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:19.526750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d16ec0d8b34ef5a676d21bc9233eca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:19.532834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1186/2405] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:19 2022] DELETE /identity/v3/users/05d16ec0d8b34ef5a676d21bc9233eca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:19.537319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:19.537772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:19.538511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:19.555241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:19.556445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:19.618040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1220/2406] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:19.628187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:19.629744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:19.683408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:19.688025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e689e6a-b082-439c-b3a4-8a93fdf537e8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:19.692734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:19.693696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:19.694219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:19.694556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:19.703913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:19.705348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:19.714703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1187/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:20.000207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:20.002932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:20.016627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50633134-f1da-4a4d-ba69-db5d40222032 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:20.021604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:20.022517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.022804 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.023115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] PATH_INFO: `/v3/projects/faa7e0cb6f344b8f982437fec503b4b6` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.024345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa7e0cb6f344b8f982437fec503b4b6)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:20.026258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:20.045614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:20.074740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa7e0cb6f344b8f982437fec503b4b6', 'request_id': 'req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.081501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa7e0cb6f344b8f982437fec503b4b6', 'request_id': 'req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.087522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa7e0cb6f344b8f982437fec503b4b6', 'request_id': 'req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.098329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] The token cache is being invalidate because project faa7e0cb6f344b8f982437fec503b4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:20.098619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.099280 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.100805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1221/2408] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:19 2022] DELETE /identity/v3/projects/faa7e0cb6f344b8f982437fec503b4b6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:20.104736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:20.115082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112918b-75d0-4957-b80b-9b451a4c62be service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:20.171542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:20.172421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.172703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.172977 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] PATH_INFO: `/v3/users/ed8073a4a3a74738a8f562fb0a112d88` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.174166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8073a4a3a74738a8f562fb0a112d88)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:20.176140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:20.223239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8073a4a3a74738a8f562fb0a112d88'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.231943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8073a4a3a74738a8f562fb0a112d88'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.245065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8073a4a3a74738a8f562fb0a112d88'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.245725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8073a4a3a74738a8f562fb0a112d88'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.253565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9cd6fa59-43d3-4d83-8417-6eaec535e471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8073a4a3a74738a8f562fb0a112d88'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.259783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1188/2409] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:20 2022] DELETE /identity/v3/users/ed8073a4a3a74738a8f562fb0a112d88 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:20.526579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:20.528042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:20.540681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc8133-5f8a-42ec-b3e6-45f05da8a7cc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:20.605048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:20.606393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.606673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.606948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] PATH_INFO: `/v3/projects/6c002bbfdf8d4915a91d7358e90b50f8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.608204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c002bbfdf8d4915a91d7358e90b50f8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:20.610088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:20.657042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c002bbfdf8d4915a91d7358e90b50f8', 'request_id': 'req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.663898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c002bbfdf8d4915a91d7358e90b50f8', 'request_id': 'req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.671433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c002bbfdf8d4915a91d7358e90b50f8', 'request_id': 'req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.682259 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] The token cache is being invalidate because project 6c002bbfdf8d4915a91d7358e90b50f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:20.682548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.683230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-618d9e1b-2c16-472b-a0b3-d75c9ea65b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:20.684945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1222/2410] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:20 2022] DELETE /identity/v3/projects/6c002bbfdf8d4915a91d7358e90b50f8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:20.690399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.690817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.690959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.709399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:20.710721 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:20.771359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1189/2411] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:20.781120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.781413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.781693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.800608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:20.801853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:20.809825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1223/2412] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:23:20.814299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:20.824522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6bb98-55ac-43e4-a2eb-c434c3e9066e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:20.829441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:20.830139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.830388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.830666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.831678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:23:20.831833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:20.833328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:20.844298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:20.846832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1190/2413] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:23:20.851270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:20.861455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6496e-718d-442e-a4a2-fdd75f73fd3b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:20.866069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:20.866726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.867017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.867340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.868040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:20.869940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:20.895518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1224/2414] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:20 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:20.899763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:20.910338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207d5d0-38cb-4cd7-920a-2997263d427f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:20.968531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:20.969203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:20.969495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:20.969777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:20.970481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:20.972451 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:20.992249 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1191/2415] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:20 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:20.996476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.007117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf747a5-831d-4fc0-b119-e50921b798b5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.012511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.013174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.013465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.013749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.014471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.016102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.017337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:21.028183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1225/2416] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:21.032703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.042633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14779413-928e-4d18-8d22-6dac87656f46 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.047228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed57d2f-de22-4df9-b233-8e0eb15d6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.047872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed57d2f-de22-4df9-b233-8e0eb15d6384 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.048157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed57d2f-de22-4df9-b233-8e0eb15d6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.048440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed57d2f-de22-4df9-b233-8e0eb15d6384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.049153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed57d2f-de22-4df9-b233-8e0eb15d6384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.050740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed57d2f-de22-4df9-b233-8e0eb15d6384 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.060573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1192/2417] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:21.064700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.074861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bed60-bd8b-437e-ba09-d2382eb003f6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.079404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.080398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.080820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.081179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] PATH_INFO: `/v3/projects/b56c7c96c136439bb03c3c284f60ef4f/users/d3213b7204f44e0a9e4516b0247895fd/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.097201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56c7c96c136439bb03c3c284f60ef4f, user_id=d3213b7204f44e0a9e4516b0247895fd, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.099880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.113115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1226/2418] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:21 2022] PUT /identity/v3/projects/b56c7c96c136439bb03c3c284f60ef4f/users/d3213b7204f44e0a9e4516b0247895fd/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:21.123154 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.123457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.123742 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.151246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] MFA Rules not processed for user `d3213b7204f44e0a9e4516b0247895fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:21.153083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:21.218937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1193/2419] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:21.223346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.296442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416b41-2f19-4c74-837a-a8ca9bdfe8e4 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.301431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0eb89-b252-44d3-b07b-67528cd14273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.302088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0eb89-b252-44d3-b07b-67528cd14273 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.302377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0eb89-b252-44d3-b07b-67528cd14273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.302666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0eb89-b252-44d3-b07b-67528cd14273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.303398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0eb89-b252-44d3-b07b-67528cd14273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.305303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0eb89-b252-44d3-b07b-67528cd14273 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.331870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1227/2420] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:21 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:21.335887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.347762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a968c-77b0-4a13-a7d7-42fa5b734a3e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.408527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.409258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.409547 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.409825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.410539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.412586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.414288 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.414591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.414934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.423630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:21.435228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:21.435886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1194/2421] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:21 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:21.436705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:21.439871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.451214 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243079c1-f978-4739-99d4-e1dd11231a03 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.455917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.456571 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.456859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.457145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.457873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.459501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.469529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1195/2422] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:21.473580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.484507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87610846-7263-49fb-910a-a1a7b25d7ba8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.489585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.490572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.490862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.491176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] PATH_INFO: `/v3/projects/75810419fa3a40a39c3a3c92e357a97c/users/201b0d2b9a3f4c8c931652e8503928ca/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.496733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1228/2423] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:23:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:21.506675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75810419fa3a40a39c3a3c92e357a97c, user_id=201b0d2b9a3f4c8c931652e8503928ca, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.509427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.523864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1196/2424] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:21 2022] PUT /identity/v3/projects/75810419fa3a40a39c3a3c92e357a97c/users/201b0d2b9a3f4c8c931652e8503928ca/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:21.528036 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.540935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f221-6e93-4715-95e0-c9ff490f3b19 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.544825 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.546524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:21.604681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.605407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.605728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.606013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.606749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.608554 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.611669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:21.618068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcba8be-2608-4f82-b37d-8bdfbfc3e130 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.624946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1229/2425] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:23:21.625080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.625080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.625080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.625384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.625722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.636452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d755d9-e3f1-4d43-ab7e-8ddb146f9f6e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.642973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3b735-0a7b-4d54-8e5b-fa9dda78eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:21.643961 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3b735-0a7b-4d54-8e5b-fa9dda78eb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.644302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3b735-0a7b-4d54-8e5b-fa9dda78eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.644593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3b735-0a7b-4d54-8e5b-fa9dda78eb87 admin admin] PATH_INFO: `/v3/projects/75810419fa3a40a39c3a3c92e357a97c/users/201b0d2b9a3f4c8c931652e8503928ca/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.646719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3b735-0a7b-4d54-8e5b-fa9dda78eb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75810419fa3a40a39c3a3c92e357a97c, user_id=201b0d2b9a3f4c8c931652e8503928ca, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.649396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3b735-0a7b-4d54-8e5b-fa9dda78eb87 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.661107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1230/2426] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:21 2022] PUT /identity/v3/projects/75810419fa3a40a39c3a3c92e357a97c/users/201b0d2b9a3f4c8c931652e8503928ca/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:21.672359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:21.672907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:21.673193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:21.695722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:21.697471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:21.699594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] MFA Rules not processed for user `201b0d2b9a3f4c8c931652e8503928ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:21.700792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:21.706328 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1197/2427] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:23:21.784418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1231/2428] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:23:21.795391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:21.796844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:21.918896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701140-49fa-474d-8088-b46e75d9c93a service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:21.939989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:22.008951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:22.009642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:22.009938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:22.010228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:22.096899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:22.098390 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:22.139031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:22.141273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:22.162636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1198/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:22.255616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4d5a1-16ba-4345-919e-869c4a7ed063 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:22.269434 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:22.270108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:22.270394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:22.270873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:22.272745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:22.291344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:22.293570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:22.318957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1232/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:23:24.845866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:24.856204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937da64-849f-4c66-85ef-c2f740125554 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:24.860447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:24.861297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:24.861783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:24.862217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:24.874810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:24.876851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:24.896231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1199/2431] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:31.455364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:31.456890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:31.528439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc516277-3ef4-430c-951a-89fe9a2e8748 service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:31.532528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:31.533193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:31.533483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:31.533914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:31.535711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:31.545663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:31.547118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:31.550270 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:31.556251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1233/2432] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:32.957748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:32.970876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad0742-cdb3-4300-87cb-c67b3a7bc927 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:32.976367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:32.976998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:32.977304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:32.977567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:32.979337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:33.040003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:33.041538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:33.050815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1200/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:36.411973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:36.413393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:36.484925 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36d536-957e-44d6-bde7-a6b4568b931f service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:36.490309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:36.490966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:36.491298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:36.491580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:36.493577 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:36.506161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:36.507810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9e834-1a25-41ae-bd6a-951355490dba service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:36.518102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1234/2434] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:37.575193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:37.637588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:37.641786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678adb6-d7eb-4b54-95e0-4c3b713c1d41 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:37.647600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:37.648429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:37.648778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:37.649361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] PATH_INFO: `/v3/users/d3213b7204f44e0a9e4516b0247895fd` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:37.650664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3213b7204f44e0a9e4516b0247895fd)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:37.652906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:37.707196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3213b7204f44e0a9e4516b0247895fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:37.715146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3213b7204f44e0a9e4516b0247895fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:37.728278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3213b7204f44e0a9e4516b0247895fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:37.728930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3213b7204f44e0a9e4516b0247895fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:37.736402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3213b7204f44e0a9e4516b0247895fd'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:37.742541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1201/2435] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:37 2022] DELETE /identity/v3/users/d3213b7204f44e0a9e4516b0247895fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:37.747586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab929fb-4222-46a0-b916-2f4e08dd5599 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:37.748080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab929fb-4222-46a0-b916-2f4e08dd5599 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:37.748184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab929fb-4222-46a0-b916-2f4e08dd5599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:37.765064 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0ab929fb-4222-46a0-b916-2f4e08dd5599 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:37.766493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0ab929fb-4222-46a0-b916-2f4e08dd5599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:37.828925 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1235/2436] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:37.839302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:37.841110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:37.899520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2967c-a51f-4413-b94a-9aacf48feae2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:37.903586 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:37.904237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:37.904523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:37.904803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:37.915558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:37.916997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:37.928038 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1202/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:23:38.163626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:38.163927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:38.164214 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:38.183761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:38.185108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:38.198932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:38.201043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:38.217240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facdbf3-f2b7-4441-9d2a-95c3c9a0c3cd service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:38.222198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:38.223229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:38.223592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:38.224044 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] PATH_INFO: `/v3/projects/b56c7c96c136439bb03c3c284f60ef4f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:38.225229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56c7c96c136439bb03c3c284f60ef4f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:38.227577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:38.248700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1236/2438] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:38.263298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:38.264780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:38.284023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56c7c96c136439bb03c3c284f60ef4f', 'request_id': 'req-cc96681e-d38f-45ab-b87d-02fa9e94df37'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.295329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56c7c96c136439bb03c3c284f60ef4f', 'request_id': 'req-cc96681e-d38f-45ab-b87d-02fa9e94df37'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.301595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56c7c96c136439bb03c3c284f60ef4f', 'request_id': 'req-cc96681e-d38f-45ab-b87d-02fa9e94df37'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.313063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] The token cache is being invalidate because project b56c7c96c136439bb03c3c284f60ef4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:38.313360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.314019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.315609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1203/2439] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:38 2022] DELETE /identity/v3/projects/b56c7c96c136439bb03c3c284f60ef4f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:38.317126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:38.319375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:38.320926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:38.326595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:38.358582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5663c37-82a6-4e8f-b827-7ef2238cf477 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:38.399869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96681e-d38f-45ab-b87d-02fa9e94df37 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:38.405857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:38.406789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:38.407165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:38.407430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] PATH_INFO: `/v3/users/201b0d2b9a3f4c8c931652e8503928ca` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:38.408783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201b0d2b9a3f4c8c931652e8503928ca)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:38.410599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:38.429181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:38.429840 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:38.430132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:38.430416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:38.432342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:38.462202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201b0d2b9a3f4c8c931652e8503928ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.471575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201b0d2b9a3f4c8c931652e8503928ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.487945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201b0d2b9a3f4c8c931652e8503928ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.488786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201b0d2b9a3f4c8c931652e8503928ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.494436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:38.496345 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73264d04-2816-4e6d-9be6-9bd679869f4a service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:38.496492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201b0d2b9a3f4c8c931652e8503928ca'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:38.502650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1204/2440] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:38 2022] DELETE /identity/v3/users/201b0d2b9a3f4c8c931652e8503928ca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:38.515365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1237/2441] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:23:39.050968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.053368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:39.147735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63d473-15fd-48a7-b48a-844012e86586 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.153304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.154481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.155097 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.155541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] PATH_INFO: `/v3/projects/75810419fa3a40a39c3a3c92e357a97c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.157373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] RBAC: Authorizing `identity:delete_project(project_id=75810419fa3a40a39c3a3c92e357a97c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.159808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.207834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:39.240205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75810419fa3a40a39c3a3c92e357a97c', 'request_id': 'req-6cb03b35-fff9-4874-8ae0-9e72eda9518c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:39.249572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75810419fa3a40a39c3a3c92e357a97c', 'request_id': 'req-6cb03b35-fff9-4874-8ae0-9e72eda9518c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:39.257295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75810419fa3a40a39c3a3c92e357a97c', 'request_id': 'req-6cb03b35-fff9-4874-8ae0-9e72eda9518c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:39.268893 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] The token cache is being invalidate because project 75810419fa3a40a39c3a3c92e357a97c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:39.269185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:39.269997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6cb03b35-fff9-4874-8ae0-9e72eda9518c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:39.272069 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1205/2442] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:39 2022] DELETE /identity/v3/projects/75810419fa3a40a39c3a3c92e357a97c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:39.277888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.278469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.278587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.299869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:39.301998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:39.368905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1238/2443] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:39.377670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.377971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.378257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.401703 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:39.403672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:39.417855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1206/2444] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:39.419228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.429307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f54f5-20ae-44b1-90df-f697093a44ff None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.433970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.434638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.434929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.435241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.435971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:23:39.436544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.438149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.451166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1239/2445] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:23:39.455608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.467492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a35e-3a32-4d7a-a6f0-64b0bc790afe None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.472274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.472946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.473238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.473530 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.474223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.476414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.510631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1207/2446] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:39 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:23:39.514944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.521348 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:39.525484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b5a77-a884-448a-a64e-874d7e30e8bd admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.586393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.587227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.587592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.587944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.588784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.591440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.615323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1240/2447] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:39 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:23:39.619554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.630252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdec7f3-1f52-46d0-9f89-9621971d4a9d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.635144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.635816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.636106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.636388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.637159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.638778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.649720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1208/2448] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:39.655137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.666897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743eeeb-b284-4677-ac3e-78767b394de7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.672449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909ac44-fe0c-493e-a66e-d45538d50356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.673185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ac44-fe0c-493e-a66e-d45538d50356 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.673468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ac44-fe0c-493e-a66e-d45538d50356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.673778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909ac44-fe0c-493e-a66e-d45538d50356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.674486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909ac44-fe0c-493e-a66e-d45538d50356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.676175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909ac44-fe0c-493e-a66e-d45538d50356 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.688277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1241/2449] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:39.692491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.702767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f2050-5146-484f-977c-2b8b134e2bba admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:39.707517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:39.708404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.708686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.708964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] PATH_INFO: `/v3/projects/bf47836eb4ae4782ae4f308d22918a8f/users/2df5c99efb2c47e3bb7ff55dd0d0bd6b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.726284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf47836eb4ae4782ae4f308d22918a8f, user_id=2df5c99efb2c47e3bb7ff55dd0d0bd6b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:39.728956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:39.742438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1209/2450] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:39 2022] PUT /identity/v3/projects/bf47836eb4ae4782ae4f308d22918a8f/users/2df5c99efb2c47e3bb7ff55dd0d0bd6b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:39.753922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:39.754391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:39.754676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:39.784900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] MFA Rules not processed for user `2df5c99efb2c47e3bb7ff55dd0d0bd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:39.786113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:39.885693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1242/2451] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:39.899421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:39.901759 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:39.995914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c8ad5-a7b3-4d66-9577-cd57e3c8c58a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:40.000517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae05a-dbda-497b-a4f7-dfa3897c90cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:40.001180 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae05a-dbda-497b-a4f7-dfa3897c90cb service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:40.001471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae05a-dbda-497b-a4f7-dfa3897c90cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:40.001854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae05a-dbda-497b-a4f7-dfa3897c90cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:40.015769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae05a-dbda-497b-a4f7-dfa3897c90cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:40.017247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ae05a-dbda-497b-a4f7-dfa3897c90cb service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:40.031736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1210/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:40.052548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:40.146989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bfed61-0650-4026-9e95-4bd46d30304d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:40.151660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:40.152558 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:40.152844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:40.153122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] PATH_INFO: `/v3/users/2df5c99efb2c47e3bb7ff55dd0d0bd6b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:40.154314 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df5c99efb2c47e3bb7ff55dd0d0bd6b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:40.156269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:40.170183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:40.227469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df5c99efb2c47e3bb7ff55dd0d0bd6b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.234948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df5c99efb2c47e3bb7ff55dd0d0bd6b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.235608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df5c99efb2c47e3bb7ff55dd0d0bd6b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.248714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df5c99efb2c47e3bb7ff55dd0d0bd6b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.249338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df5c99efb2c47e3bb7ff55dd0d0bd6b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.261597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1243/2453] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:40 2022] DELETE /identity/v3/users/2df5c99efb2c47e3bb7ff55dd0d0bd6b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:40.266568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:40.267145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:40.267145 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:40.284726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:40.285930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:40.348045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:40.363529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1211/2454] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:40.373744 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:40.375290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:40.440279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb7a3a-7122-439a-8684-d66d76f5b54d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:40.444235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876751d-4e0a-4ea0-b758-f95ec26033c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:40.445027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876751d-4e0a-4ea0-b758-f95ec26033c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:40.445393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876751d-4e0a-4ea0-b758-f95ec26033c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:40.445745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876751d-4e0a-4ea0-b758-f95ec26033c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:40.456344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876751d-4e0a-4ea0-b758-f95ec26033c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:40.457884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876751d-4e0a-4ea0-b758-f95ec26033c1 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:40.467781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1244/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:40.781479 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:40.783680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:40.797897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758870a-7c6d-4c51-b3dc-caed032e4a83 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:40.819157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:40.820067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:40.820416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:40.820641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] PATH_INFO: `/v3/projects/bf47836eb4ae4782ae4f308d22918a8f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:40.822649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf47836eb4ae4782ae4f308d22918a8f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:40.824724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:40.879449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf47836eb4ae4782ae4f308d22918a8f', 'request_id': 'req-be2e8f11-2c21-4968-a6cc-4da2535a1494'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.890482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf47836eb4ae4782ae4f308d22918a8f', 'request_id': 'req-be2e8f11-2c21-4968-a6cc-4da2535a1494'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.908060 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf47836eb4ae4782ae4f308d22918a8f', 'request_id': 'req-be2e8f11-2c21-4968-a6cc-4da2535a1494'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.921221 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] The token cache is being invalidate because project bf47836eb4ae4782ae4f308d22918a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:40.921589 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.922562 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-be2e8f11-2c21-4968-a6cc-4da2535a1494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:40.924334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1212/2456] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:40 2022] DELETE /identity/v3/projects/bf47836eb4ae4782ae4f308d22918a8f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:40.929437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:40.929824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:40.930693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:40.955083 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:40.956433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:41.064105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1245/2457] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:41.066293 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.066584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.066867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.086517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:41.087779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:41.098521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1213/2458] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:41.100846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.112521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24519-8b6b-475f-926c-131da65a4ac1 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.125335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.126910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.130829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.131194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.132003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:23:41.132319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.133950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.154174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1246/2459] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:23:41.158254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.167651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd73f3-37c9-4100-aac0-b4fb90139b5b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.173881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.174553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.174846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.175175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.175867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.177789 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.212084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1214/2460] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:23:41 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:41.215565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.242729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5effc-086e-447c-ba19-aed6204f7997 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.288087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:41.329246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.330011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.330299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.330586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.331332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.333290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.358597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1247/2461] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:23:41 2022] POST /identity/v3/users => generated 281 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:23:41.361149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.375062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9a992-f9c5-4802-aab4-b7f89cdfd02c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.380807 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.381622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.382014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.382367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.383427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.385705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.399076 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1215/2462] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:41.403615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.414230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475325e-77df-4ec9-a411-4ba8b66d0b11 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.419539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeb4d5-2a4c-4f4a-baf5-23a40219dca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.420297 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeb4d5-2a4c-4f4a-baf5-23a40219dca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.420589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeb4d5-2a4c-4f4a-baf5-23a40219dca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.420903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeb4d5-2a4c-4f4a-baf5-23a40219dca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.421636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeb4d5-2a4c-4f4a-baf5-23a40219dca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.423255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeb4d5-2a4c-4f4a-baf5-23a40219dca8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.434246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1248/2463] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:23:41.438717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.450995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2953f2-c888-4c09-b3e6-198761ef94f9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.456333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.457625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.457992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.458330 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] PATH_INFO: `/v3/projects/c108b1dc43f44428bfaa981439877896/users/1fe939ae7d81471fbb0545c97c583c42/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.474887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c108b1dc43f44428bfaa981439877896, user_id=1fe939ae7d81471fbb0545c97c583c42, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.477962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.493925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1216/2464] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:23:41 2022] PUT /identity/v3/projects/c108b1dc43f44428bfaa981439877896/users/1fe939ae7d81471fbb0545c97c583c42/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:41.508294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce9600-a44f-4691-997d-192e56261102 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.508748 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce9600-a44f-4691-997d-192e56261102 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.509440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce9600-a44f-4691-997d-192e56261102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.537447 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ecce9600-a44f-4691-997d-192e56261102 None None] MFA Rules not processed for user `1fe939ae7d81471fbb0545c97c583c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:41.538687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ecce9600-a44f-4691-997d-192e56261102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:41.622151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1249/2465] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:23:41.628139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.629834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:41.659869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce9600-a44f-4691-997d-192e56261102 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.661374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ecce9600-a44f-4691-997d-192e56261102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:41.747583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce9600-a44f-4691-997d-192e56261102 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.751222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.751880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.752175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.752459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.761179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.762283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21e9af-f90e-4b26-86f8-f0126370a3b0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.763209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.768198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.768847 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.769148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.769418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.771224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:41.772311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1250/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:41.779801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:41.786859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:41.842903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:41.853516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.855309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e824c12-d90e-4bc1-a37f-4e7647729c67 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.877916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1217/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:41.884859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28ba36-8907-4076-987d-7fce68fb09b2 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:41.899146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:41.900972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:41.901521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:41.901521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] PATH_INFO: `/v3/users/1fe939ae7d81471fbb0545c97c583c42` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:41.902818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe939ae7d81471fbb0545c97c583c42)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:41.904956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:41.954695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe939ae7d81471fbb0545c97c583c42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:41.962864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe939ae7d81471fbb0545c97c583c42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:41.963604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe939ae7d81471fbb0545c97c583c42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.004523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe939ae7d81471fbb0545c97c583c42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.005398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe939ae7d81471fbb0545c97c583c42'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.034996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1251/2468] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:23:41 2022] DELETE /identity/v3/users/1fe939ae7d81471fbb0545c97c583c42 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:23:42.046449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:42.046798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:42.047120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:42.078946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:42.080204 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:42.204777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1218/2469] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:42.216835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:42.218281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:42.363340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8052f6c-eee1-4799-bdde-6dad80114e21 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:42.372988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07436f9-b395-40db-a3c0-f3b7dd33ebd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:42.373858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07436f9-b395-40db-a3c0-f3b7dd33ebd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:42.374154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07436f9-b395-40db-a3c0-f3b7dd33ebd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:42.374474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07436f9-b395-40db-a3c0-f3b7dd33ebd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:42.385910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07436f9-b395-40db-a3c0-f3b7dd33ebd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:42.388018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07436f9-b395-40db-a3c0-f3b7dd33ebd9 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:42.406378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1252/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:23:42.830189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:42.832445 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:42.868047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abce22-c66b-4194-ba93-e1cd7bc9f1a3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:42.878337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:42.879183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:42.879477 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:42.879766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] PATH_INFO: `/v3/projects/c108b1dc43f44428bfaa981439877896` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:42.881001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c108b1dc43f44428bfaa981439877896)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:42.882993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:42.952671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c108b1dc43f44428bfaa981439877896', 'request_id': 'req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.961972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c108b1dc43f44428bfaa981439877896', 'request_id': 'req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.971692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c108b1dc43f44428bfaa981439877896', 'request_id': 'req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.983317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] The token cache is being invalidate because project c108b1dc43f44428bfaa981439877896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:23:42.983614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.984333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:23:42.985901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1219/2471] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:23:42 2022] DELETE /identity/v3/projects/c108b1dc43f44428bfaa981439877896 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:23:52.394451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:52.980070 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:23:56.907070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:56.907542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:56.907655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:56.927338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:23:56.928540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:56.986917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1253/2472] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jun 29 11:23:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:23:56.999395 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:57.000954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:57.107466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e8a3d-4bf0-469d-ba3b-4d183a6e47a0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:57.114652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:57.115766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:57.118419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:57.118419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:57.130585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:57.132390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:57.145509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1220/2473] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:23:58.190722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:23:58.192202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:58.296948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f241c6a-0f31-40f0-bb42-796ea4b6fda4 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:23:58.304072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:23:58.306506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:23:58.306506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:23:58.306506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:23:58.310929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:23:58.327972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:23:58.329868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:23:58.343444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1254/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:23:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:04.933367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:04.935448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:05.006149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08389a-32dd-4a4f-9793-0edfbed20554 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:05.009870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:05.010541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:05.010829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:05.011138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:05.013538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:05.086927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:05.088531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:05.100595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1221/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:07.518106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:07.519559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:07.534467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71723114-4d74-4adc-8bb7-0fe0fc15cffb service nova] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:07.536299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:07.536975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:07.537260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:07.537540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:07.539350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:07.553399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:07.555279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:07.566721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1255/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:08.501491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:08.502935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:08.547270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:08.573417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9817fbb-d12c-43b6-9c7a-7c615ec8a97d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:08.579967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:08.580701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:08.581053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:08.581397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:08.583352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:08.598065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:08.599921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:08.617072 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:08.619002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:08.621475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1222/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:08.640213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d0d87-42f7-455e-b50c-d2ffc30927be service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:08.647239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:08.648243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:08.648740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:08.649649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] PATH_INFO: `/v3/users/acee9273e0714017bb29bbc578847b53` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:08.651102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acee9273e0714017bb29bbc578847b53)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:08.653560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:08.710762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acee9273e0714017bb29bbc578847b53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:08.720187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acee9273e0714017bb29bbc578847b53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:08.721117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acee9273e0714017bb29bbc578847b53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:08.736942 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acee9273e0714017bb29bbc578847b53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:08.737731 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6b187703-0bb1-41c4-9c47-76978411f3a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acee9273e0714017bb29bbc578847b53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:08.739247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:08.754292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1256/2478] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:08 2022] DELETE /identity/v3/users/acee9273e0714017bb29bbc578847b53 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:08.934971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:08.948779 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f047d0-e6ab-441c-b345-8cd6fa90665d service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.021047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.022066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.022463 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.022853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] PATH_INFO: `/v3/projects/7f366ac50f3e4d8f859a4633fdf798a2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.024215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f366ac50f3e4d8f859a4633fdf798a2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.027061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.082288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f366ac50f3e4d8f859a4633fdf798a2', 'request_id': 'req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:09.091686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f366ac50f3e4d8f859a4633fdf798a2', 'request_id': 'req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:09.098761 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f366ac50f3e4d8f859a4633fdf798a2', 'request_id': 'req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:09.110971 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] The token cache is being invalidate because project 7f366ac50f3e4d8f859a4633fdf798a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:09.111536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:09.112196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cb8cfc1-8274-4c79-9a4c-d597eff8cad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:09.113746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1223/2479] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:08 2022] DELETE /identity/v3/projects/7f366ac50f3e4d8f859a4633fdf798a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:09.118656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.118973 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.119436 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.138978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:09.140213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:09.201367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1257/2480] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:09.215174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.216607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.216915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.235421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:09.236623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:09.245654 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1224/2481] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:09.250120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.259743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c66c41-5e5e-44d7-a180-0689002d24d0 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.264943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.265593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.265880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.266156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.266873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:09.267210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.268801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.281593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1258/2482] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:09.285898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.295224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db74b6c-a3fe-4224-bf43-304f366eb0e1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.299957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.300615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.300904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.301185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.301888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.303848 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.341314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1225/2483] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:09 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:09.345241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.355478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a306e-5e41-40c9-92bd-85e0ef45d4fc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.421941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.422887 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.423424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.424379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.425255 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.428465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.452590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1259/2484] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:09 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:09.456637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.468444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb83e0-2fe5-4e84-9358-5bfd39ac9f32 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.473554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.474938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.475337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.475695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.477380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.479276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.490501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1226/2485] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:09.494902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.506851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedd0f1-9eb4-4604-9fc2-3dd04f580bbe admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.511827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5992a3f-de5e-42bc-92b2-0b0d67bd68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.512578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992a3f-de5e-42bc-92b2-0b0d67bd68a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.512876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992a3f-de5e-42bc-92b2-0b0d67bd68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.513162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5992a3f-de5e-42bc-92b2-0b0d67bd68a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.513914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992a3f-de5e-42bc-92b2-0b0d67bd68a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.515691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5992a3f-de5e-42bc-92b2-0b0d67bd68a0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.528571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1260/2486] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:09.531610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.545481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416a62-181c-4740-8f1e-306ee6776f5d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.551153 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.552302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.552834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.553332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] PATH_INFO: `/v3/projects/4e4b426b05284ea6a1ce94d166ec5d31/users/86835e8974ae4c7b843589b4b6f04c6f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.563236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:09.571251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4b426b05284ea6a1ce94d166ec5d31, user_id=86835e8974ae4c7b843589b4b6f04c6f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.574780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.594103 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1227/2487] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:09 2022] PUT /identity/v3/projects/4e4b426b05284ea6a1ce94d166ec5d31/users/86835e8974ae4c7b843589b4b6f04c6f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:09.604264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.604681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.605279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.638357 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] MFA Rules not processed for user `86835e8974ae4c7b843589b4b6f04c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:09.640416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:09.693495 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:09.721709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1261/2488] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:09.732587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:09.735251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:09.822149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db663309-d435-464e-bde4-e569871eb16a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:09.828124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:09.828953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:09.829314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:09.829668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:09.839131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:09.840870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:09.851132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1228/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:11.266656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:11.268115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:11.347952 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c1b1a-6735-4f4d-9850-8f14bdb141b9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:11.352544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:11.353418 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:11.353705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:11.353984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] PATH_INFO: `/v3/users/fb03aabb4dfe4e17bf12831cc5824612` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:11.355217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb03aabb4dfe4e17bf12831cc5824612)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:11.357156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:11.411342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb03aabb4dfe4e17bf12831cc5824612'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.421211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb03aabb4dfe4e17bf12831cc5824612'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.421833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb03aabb4dfe4e17bf12831cc5824612'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.437401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb03aabb4dfe4e17bf12831cc5824612'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.438091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6dfe0142-dd83-4899-9178-57db426550e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb03aabb4dfe4e17bf12831cc5824612'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.452333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1262/2490] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:11 2022] DELETE /identity/v3/users/fb03aabb4dfe4e17bf12831cc5824612 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:11.644094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:11.657967 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec271e-3646-4826-9a5b-a3260b6cf95c service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:11.718536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:11.719432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:11.719722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:11.720003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] PATH_INFO: `/v3/projects/f26e25d654ca4479850d336d1884e754` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:11.721202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26e25d654ca4479850d336d1884e754)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:11.723859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:11.769785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26e25d654ca4479850d336d1884e754', 'request_id': 'req-fbf4cd65-c82b-4b77-adac-c73fc684798a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.776767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26e25d654ca4479850d336d1884e754', 'request_id': 'req-fbf4cd65-c82b-4b77-adac-c73fc684798a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.783338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26e25d654ca4479850d336d1884e754', 'request_id': 'req-fbf4cd65-c82b-4b77-adac-c73fc684798a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.794008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] The token cache is being invalidate because project f26e25d654ca4479850d336d1884e754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:11.794300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.794932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fbf4cd65-c82b-4b77-adac-c73fc684798a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:11.796885 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1229/2491] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:11 2022] DELETE /identity/v3/projects/f26e25d654ca4479850d336d1884e754 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:11.801634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:11.801932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:11.802213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:11.820196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:11.821394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:11.882366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1263/2492] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:11.891064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:11.891351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:11.891628 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:11.897866 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:11.912471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:11.913711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:11.921908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1230/2493] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:11.925812 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:11.931815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:11.936637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250482b3-9189-4867-bb2c-e8f9702fa8f5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:11.942960 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:11.943790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:11.944209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:11.944492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:11.945210 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:11.945522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:11.947155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:11.959320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1264/2494] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:11.963452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:11.972629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5aa8-36ca-4c9b-af6b-1db89e4ae339 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:11.977198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:11.977832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:11.978114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:11.978391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:11.979226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:11.981720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.007466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1231/2495] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:11 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:12.011640 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.021525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2fab-01ee-4ba5-966c-f0a4c1278250 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:12.076739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:12.077400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.077717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.077998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.078689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:12.080625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.100388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1265/2496] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:12 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:12.104588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.115433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa1ab9-60ff-43fd-96a8-8076913bf6bf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:12.120062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:12.120738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.121023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.121302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.122733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:12.124704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.135503 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1232/2497] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:12.139285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.149405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8cc51-28bb-4db5-838d-c6c59a979c1e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:12.154183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d10d-0348-4abe-9d70-c8fa0d9663bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:12.155221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d10d-0348-4abe-9d70-c8fa0d9663bb admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.155508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d10d-0348-4abe-9d70-c8fa0d9663bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.155788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d10d-0348-4abe-9d70-c8fa0d9663bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.156502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7d10d-0348-4abe-9d70-c8fa0d9663bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:12.158084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7d10d-0348-4abe-9d70-c8fa0d9663bb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.167801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1266/2498] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:12.172660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.184712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49cc64-6b66-47b5-8afe-887e267c4b96 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:12.190094 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:12.191220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.191671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.191962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] PATH_INFO: `/v3/projects/80f6fdc20776445ba7c253d1e3f7a1e3/users/8c00f325db2d42d8b7a293c3131d5809/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.207639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f6fdc20776445ba7c253d1e3f7a1e3, user_id=8c00f325db2d42d8b7a293c3131d5809, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:12.210283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.223173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1233/2499] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:12 2022] PUT /identity/v3/projects/80f6fdc20776445ba7c253d1e3f7a1e3/users/8c00f325db2d42d8b7a293c3131d5809/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:12.233321 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.233616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.233899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.259514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] MFA Rules not processed for user `8c00f325db2d42d8b7a293c3131d5809`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:12.260711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:12.324396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1267/2500] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:12.335380 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.337160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:12.409788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be5121-d50a-42e6-8f0d-d008547e6336 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:12.415462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2dbc3-ae4f-4474-ae3f-ab92822022f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:12.416102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2dbc3-ae4f-4474-ae3f-ab92822022f9 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.416392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2dbc3-ae4f-4474-ae3f-ab92822022f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.416675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2dbc3-ae4f-4474-ae3f-ab92822022f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.424452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2dbc3-ae4f-4474-ae3f-ab92822022f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:12.426055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2dbc3-ae4f-4474-ae3f-ab92822022f9 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.435384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1234/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:12.663206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.748663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adf202-c1ff-44c2-8a78-490df528e269 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:12.753595 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:12.754475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.754757 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.755028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] PATH_INFO: `/v3/users/8c00f325db2d42d8b7a293c3131d5809` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.756342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c00f325db2d42d8b7a293c3131d5809)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:12.758422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:12.760200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:12.814908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c00f325db2d42d8b7a293c3131d5809'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:12.822190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c00f325db2d42d8b7a293c3131d5809'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:12.822874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c00f325db2d42d8b7a293c3131d5809'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:12.835397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c00f325db2d42d8b7a293c3131d5809'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:12.836160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c00f325db2d42d8b7a293c3131d5809'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:12.848906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1268/2502] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:12 2022] DELETE /identity/v3/users/8c00f325db2d42d8b7a293c3131d5809 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:12.853436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:12.853891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:12.854010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:12.871631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:12.873464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:12.932746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1235/2503] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:12.943956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:12.945399 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:13.006381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec55583-16f6-4509-a807-873c198bb86d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.010430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bcb06-016f-4d94-9e5a-1373bb5bf71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.011114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcb06-016f-4d94-9e5a-1373bb5bf71f service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.011407 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcb06-016f-4d94-9e5a-1373bb5bf71f service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.011690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcb06-016f-4d94-9e5a-1373bb5bf71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.020869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bcb06-016f-4d94-9e5a-1373bb5bf71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.025700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bcb06-016f-4d94-9e5a-1373bb5bf71f service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.037502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1269/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:13.302200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.303734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:13.316776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e805fa-b191-4d4b-a2b0-ac0f4c0cad0f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.321471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.322378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.322670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.322956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] PATH_INFO: `/v3/projects/80f6fdc20776445ba7c253d1e3f7a1e3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.324186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f6fdc20776445ba7c253d1e3f7a1e3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.326776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.348366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:13.373752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f6fdc20776445ba7c253d1e3f7a1e3', 'request_id': 'req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:13.381095 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f6fdc20776445ba7c253d1e3f7a1e3', 'request_id': 'req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:13.387546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f6fdc20776445ba7c253d1e3f7a1e3', 'request_id': 'req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:13.401747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] The token cache is being invalidate because project 80f6fdc20776445ba7c253d1e3f7a1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:13.402081 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:13.402920 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d7b5a4bc-37ee-45e5-82ea-983f864bf2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:13.405064 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1236/2505] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:13 2022] DELETE /identity/v3/projects/80f6fdc20776445ba7c253d1e3f7a1e3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:13.411550 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.412040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.412234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.431125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:13.432317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:13.491114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1270/2506] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:13.498625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.498916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.499235 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.517415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:13.518621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:13.526305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1237/2507] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:13.531033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.540694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02298cfe-96f4-4dbd-9e2f-246fe907ae3f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.545308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.545955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.546245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.546527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.547302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:13.547613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.549207 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.560645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1271/2508] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:13.565011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.574138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ab40d-999f-4070-980e-d7dfba85b83f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.579541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.580186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.580475 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.580754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.581455 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.583379 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.609093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1238/2509] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:13 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:13.612955 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.622758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f96b6-7282-408d-a699-b74f0a4af742 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.627312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:13.681086 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.681683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.681972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.682253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.682938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.686986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.705880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1272/2510] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:13 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:13.709918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.721310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e913649-7b76-4226-b5b7-f8cdcd0fc505 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.726082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.726753 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.727032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.727340 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.728086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.729689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.741792 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1239/2511] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:13.745734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.756645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83c30d-71ab-4c2a-859c-66657ed882b8 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.762457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a45b5-1036-4043-9a5f-14d7601d0fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.763196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a45b5-1036-4043-9a5f-14d7601d0fda admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.763492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a45b5-1036-4043-9a5f-14d7601d0fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.763778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a45b5-1036-4043-9a5f-14d7601d0fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.764501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a45b5-1036-4043-9a5f-14d7601d0fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.766117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a45b5-1036-4043-9a5f-14d7601d0fda admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.776359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1273/2512] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:13.780462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:13.790288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fff4d2-cad4-4a8b-bc53-2f68573ad7ce admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:13.795413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:13.796962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.797251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.797531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] PATH_INFO: `/v3/projects/a94293d377884832b6b8ee8ae14e1818/users/0dea4e767cd7482ba7bae9facbf93a3d/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.813824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94293d377884832b6b8ee8ae14e1818, user_id=0dea4e767cd7482ba7bae9facbf93a3d, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:13.816519 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:13.832528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1240/2513] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:13 2022] PUT /identity/v3/projects/a94293d377884832b6b8ee8ae14e1818/users/0dea4e767cd7482ba7bae9facbf93a3d/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:13.843269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:13.843670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:13.843880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:13.873790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] MFA Rules not processed for user `0dea4e767cd7482ba7bae9facbf93a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:13.874990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:13.947470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1274/2514] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:13.952581 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.016093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba38f0-d0a6-4f2c-8ad6-a1bdaa698c67 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.020801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.021459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.021749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.022030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.022734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.024676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.051120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1241/2515] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:14.055409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.067834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab6846-4f60-4987-bc11-9873458a0e0d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.125569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.126243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.126532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.126815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.127553 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.129485 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.150166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1275/2516] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:14 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:14.154459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.165595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe0d3f-9fdd-47df-9bcb-90d27d9df4fc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.171780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.172682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.172974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.173299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.175587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.178440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.191720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1242/2517] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:14.196009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.206605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cda37-a2d2-4f35-8e55-a2e871824958 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.211310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.212182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.212471 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.212747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] PATH_INFO: `/v3/projects/3fef232bc5704b9f92ab7d9d2d54641b/users/51feae3f2b6849bebe6db607a41351b2/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.214991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:14.230712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fef232bc5704b9f92ab7d9d2d54641b, user_id=51feae3f2b6849bebe6db607a41351b2, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.234087 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.248433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1276/2518] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:14 2022] PUT /identity/v3/projects/3fef232bc5704b9f92ab7d9d2d54641b/users/51feae3f2b6849bebe6db607a41351b2/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:14.252585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.264332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c0af6-7564-4250-a68d-e28c3064c407 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.276608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:14.323539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a2593-b5c9-4c60-870b-cadefa537329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.324209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2593-b5c9-4c60-870b-cadefa537329 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.324498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2593-b5c9-4c60-870b-cadefa537329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.324777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a2593-b5c9-4c60-870b-cadefa537329 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.325504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a2593-b5c9-4c60-870b-cadefa537329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.327132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a2593-b5c9-4c60-870b-cadefa537329 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.336732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1243/2519] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:14.340892 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.351065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81295663-737e-4fe3-8d57-754b9319e9a9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.355621 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.356492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.356778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.357560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] PATH_INFO: `/v3/projects/3fef232bc5704b9f92ab7d9d2d54641b/users/51feae3f2b6849bebe6db607a41351b2/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.359542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fef232bc5704b9f92ab7d9d2d54641b, user_id=51feae3f2b6849bebe6db607a41351b2, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.362152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.372351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1277/2520] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:14 2022] PUT /identity/v3/projects/3fef232bc5704b9f92ab7d9d2d54641b/users/51feae3f2b6849bebe6db607a41351b2/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:14.382716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.383008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.383311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.409908 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] MFA Rules not processed for user `51feae3f2b6849bebe6db607a41351b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:14.411138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:14.479166 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1244/2521] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:14.489816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:14.491623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:14.547674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152f25d-c1d9-459d-a2da-58d66c96bd07 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:14.551267 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:14.551904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:14.552190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:14.552466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:14.562079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:14.563537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:14.572763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1278/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:14.938438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.007616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe6292-cbe3-4ef3-b795-a0edf71990b6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.015948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.015948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.017093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.017093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] PATH_INFO: `/v3/users/0dea4e767cd7482ba7bae9facbf93a3d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.017954 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dea4e767cd7482ba7bae9facbf93a3d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.019932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.073720 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:15.079832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dea4e767cd7482ba7bae9facbf93a3d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.087377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dea4e767cd7482ba7bae9facbf93a3d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.100906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.102007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.104984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dea4e767cd7482ba7bae9facbf93a3d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.105666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dea4e767cd7482ba7bae9facbf93a3d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.113230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-850bd954-b082-4aea-a490-88beb70387c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dea4e767cd7482ba7bae9facbf93a3d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.115947 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759e9cd-05c8-4211-974f-b2cb2de641c7 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.119276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1245/2523] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:14 2022] DELETE /identity/v3/users/0dea4e767cd7482ba7bae9facbf93a3d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:15.122127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.122127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.122127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.122127 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] PATH_INFO: `/v3/users/86835e8974ae4c7b843589b4b6f04c6f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.124139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea42ea-d450-4a0f-b3ed-b1be6b03944d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.124250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86835e8974ae4c7b843589b4b6f04c6f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.124437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea42ea-d450-4a0f-b3ed-b1be6b03944d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.124726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea42ea-d450-4a0f-b3ed-b1be6b03944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.126370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.142436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-02ea42ea-d450-4a0f-b3ed-b1be6b03944d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:15.143650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-02ea42ea-d450-4a0f-b3ed-b1be6b03944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.174963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86835e8974ae4c7b843589b4b6f04c6f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.182726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86835e8974ae4c7b843589b4b6f04c6f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.183465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86835e8974ae4c7b843589b4b6f04c6f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.196971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86835e8974ae4c7b843589b4b6f04c6f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.197689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86835e8974ae4c7b843589b4b6f04c6f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.206764 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1246/2524] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:15.211650 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1279/2525] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:15 2022] DELETE /identity/v3/users/86835e8974ae4c7b843589b4b6f04c6f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:15.216071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.216928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.217217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.217458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.218817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.235116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:15.236349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.270450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:15.285302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a434a3-c36c-4efe-bb39-fa6854a24d9f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.289446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.290172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.290465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.290747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.298229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1247/2526] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:15.307686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.309007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.321377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88cc9e-3a9f-40e0-9421-4f372df4b814 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.324983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.325664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.326456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.326733 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.336369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.337863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.347682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1248/2527] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:15.352188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.353639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.363339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1280/2528] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:15.627376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.628852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.642894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e697a-ee4c-41c7-8b98-b851a8d047e8 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.647325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.649052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.661190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.662189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.662584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.663082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] PATH_INFO: `/v3/projects/4e4b426b05284ea6a1ce94d166ec5d31` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.663201 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e97ee5-d95f-4781-aa53-f9b9491eed64 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.664439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4b426b05284ea6a1ce94d166ec5d31)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.666435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.667909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.668930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.669301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.670235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] PATH_INFO: `/v3/projects/a94293d377884832b6b8ee8ae14e1818` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.671579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94293d377884832b6b8ee8ae14e1818)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.673688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.713783 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:15.722173 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4b426b05284ea6a1ce94d166ec5d31', 'request_id': 'req-8839c887-90e4-4fcb-99ae-e95f05605764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.725604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94293d377884832b6b8ee8ae14e1818', 'request_id': 'req-f296904b-9279-4f79-989d-a6a5ff0ef259'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.731021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4b426b05284ea6a1ce94d166ec5d31', 'request_id': 'req-8839c887-90e4-4fcb-99ae-e95f05605764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.733779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94293d377884832b6b8ee8ae14e1818', 'request_id': 'req-f296904b-9279-4f79-989d-a6a5ff0ef259'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.737810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4b426b05284ea6a1ce94d166ec5d31', 'request_id': 'req-8839c887-90e4-4fcb-99ae-e95f05605764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.740145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94293d377884832b6b8ee8ae14e1818', 'request_id': 'req-f296904b-9279-4f79-989d-a6a5ff0ef259'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.748671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] The token cache is being invalidate because project 4e4b426b05284ea6a1ce94d166ec5d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:15.748998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.749621 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8839c887-90e4-4fcb-99ae-e95f05605764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.750428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] The token cache is being invalidate because project a94293d377884832b6b8ee8ae14e1818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:15.750720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.751200 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1249/2529] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:15 2022] DELETE /identity/v3/projects/4e4b426b05284ea6a1ce94d166ec5d31 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:15.754494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.754494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1281/2530] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:15 2022] DELETE /identity/v3/projects/a94293d377884832b6b8ee8ae14e1818 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:15.756491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0c9c-9c84-492c-a97b-4d51d717cee3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.756782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0c9c-9c84-492c-a97b-4d51d717cee3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.756911 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.757063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e0c9c-9c84-492c-a97b-4d51d717cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.758206 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.775397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2b6e0c9c-9c84-492c-a97b-4d51d717cee3 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:15.776499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2b6e0c9c-9c84-492c-a97b-4d51d717cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.823824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296904b-9279-4f79-989d-a6a5ff0ef259 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.829022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.829934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.830219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.830500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] PATH_INFO: `/v3/users/51feae3f2b6849bebe6db607a41351b2` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.831759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51feae3f2b6849bebe6db607a41351b2)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.833672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.838822 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1250/2531] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:15.847728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.848026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.848307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.856853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:15.867152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:15.868311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.876909 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1251/2532] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:15.880989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.883965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51feae3f2b6849bebe6db607a41351b2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.890582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc2c10-4cc3-49ad-b275-4e2be7283b6b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.892714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51feae3f2b6849bebe6db607a41351b2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.893415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51feae3f2b6849bebe6db607a41351b2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.895583 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.896216 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.896505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.896786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.897506 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:15.897817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.899447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:15.907104 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51feae3f2b6849bebe6db607a41351b2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.907886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51feae3f2b6849bebe6db607a41351b2'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:15.912311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1252/2533] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:24:15.916652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:15.918283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:15.920882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1282/2534] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:15 2022] DELETE /identity/v3/users/51feae3f2b6849bebe6db607a41351b2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:15.931916 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eca9e0-ac4e-4360-8fc3-a4cfdbdd5533 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:15.992296 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:15.992972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:15.993261 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:15.993561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:15.994308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:15.996714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.025747 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1253/2535] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:15 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:16.030333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.040672 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce804c-1e35-4109-b6d8-4893c13aadb9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.104771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.105449 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.105733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.106010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.106700 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.109275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.132339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1283/2536] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:16.133631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.144688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b44dd-53b8-47b5-a45c-be472ba106be admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.149413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.150075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.150365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.150648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.151410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.153019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.163693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1254/2537] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:16.167593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.178560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181e0ac-177a-4769-8c94-3d2621f81804 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.184268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.185691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.185953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.186536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.187311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.188903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.199847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1284/2538] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:16.204236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.204561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.206592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:16.215893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e3df8-f09b-4a17-abdc-7376f4abcc29 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.221350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21df00-b27d-40a5-b66c-e0cfb7153633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.222251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21df00-b27d-40a5-b66c-e0cfb7153633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.222539 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21df00-b27d-40a5-b66c-e0cfb7153633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.222824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21df00-b27d-40a5-b66c-e0cfb7153633 admin admin] PATH_INFO: `/v3/projects/a481805dcb7042568d877139d145e2a3/users/18b308320e23413b9c196a9b91a04a3b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.223245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c9b9b-f96b-45c1-8275-51a523041fcb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.235100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.235943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.236171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.236454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] PATH_INFO: `/v3/projects/3fef232bc5704b9f92ab7d9d2d54641b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.237739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fef232bc5704b9f92ab7d9d2d54641b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.239331 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21df00-b27d-40a5-b66c-e0cfb7153633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a481805dcb7042568d877139d145e2a3, user_id=18b308320e23413b9c196a9b91a04a3b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.239926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.241949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21df00-b27d-40a5-b66c-e0cfb7153633 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.255596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1285/2539] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:16 2022] PUT /identity/v3/projects/a481805dcb7042568d877139d145e2a3/users/18b308320e23413b9c196a9b91a04a3b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:16.266192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.266488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.266792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.268007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:16.297482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] MFA Rules not processed for user `18b308320e23413b9c196a9b91a04a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:16.298720 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:16.301763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fef232bc5704b9f92ab7d9d2d54641b', 'request_id': 'req-b5bd7fad-01ed-46c2-a582-89391a66285b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:16.309058 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fef232bc5704b9f92ab7d9d2d54641b', 'request_id': 'req-b5bd7fad-01ed-46c2-a582-89391a66285b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:16.317268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fef232bc5704b9f92ab7d9d2d54641b', 'request_id': 'req-b5bd7fad-01ed-46c2-a582-89391a66285b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:16.328400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] The token cache is being invalidate because project 3fef232bc5704b9f92ab7d9d2d54641b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:16.328693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:16.329381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b5bd7fad-01ed-46c2-a582-89391a66285b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:16.331003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1255/2540] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:16 2022] DELETE /identity/v3/projects/3fef232bc5704b9f92ab7d9d2d54641b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:16.335661 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdeea2-513b-4db9-9f29-26927cecce36 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.335952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdeea2-513b-4db9-9f29-26927cecce36 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.336233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdeea2-513b-4db9-9f29-26927cecce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.344050 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:16.354725 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0abdeea2-513b-4db9-9f29-26927cecce36 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:16.356115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0abdeea2-513b-4db9-9f29-26927cecce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:16.369639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1286/2541] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:16.380914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.382236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:16.418710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1256/2542] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:16.427548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.427917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.428278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.448925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:16.449342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550b37c-c005-4dc7-987a-8efb214d4fec None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.450406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:16.453530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.454182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.454466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.454747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.461233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1257/2543] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:16.463860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.465615 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.465728 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.475260 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61bbdb-90b0-423c-9d1b-d4916ca9af61 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.475414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1287/2544] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:16.479899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.480548 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.480838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.481122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.482371 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:16.482693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.484333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.496457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1258/2545] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:24:16.501586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.512778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f4f2-248e-4bc8-ab23-17d27bc52df7 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.517634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.518294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.518602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.518890 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.519648 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.521559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.552198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1288/2546] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:16.553350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.564440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff51e5-9c78-4742-96d6-9547f3130a9d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.624222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.625201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.625347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.625693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.626341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.628365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.652263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1259/2547] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:16.653413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.665609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa392-8793-4b6b-8a36-1ad597dbd49e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.670212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.670872 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.671200 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.671482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.672197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.673776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.684813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1289/2548] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:16.690036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.699882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206dde1-a0b9-485d-a31e-a3a1b9ae5762 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.706738 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23780b9-9ca2-4479-80d4-030d454ffa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.707517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23780b9-9ca2-4479-80d4-030d454ffa83 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.708068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23780b9-9ca2-4479-80d4-030d454ffa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.708443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23780b9-9ca2-4479-80d4-030d454ffa83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.709264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23780b9-9ca2-4479-80d4-030d454ffa83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.711001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23780b9-9ca2-4479-80d4-030d454ffa83 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.725930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1260/2549] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:16.728266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.743763 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53156f-bea8-406b-ad50-e3fe162ddf1f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.748827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.749862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.750148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.750428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] PATH_INFO: `/v3/projects/7fdb3ec2f7384f009c779fbf284f25af/users/eab3fb25879b46469011f5b04026cbc5/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.771458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdb3ec2f7384f009c779fbf284f25af, user_id=eab3fb25879b46469011f5b04026cbc5, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.774936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:16.790570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1290/2550] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:16 2022] PUT /identity/v3/projects/7fdb3ec2f7384f009c779fbf284f25af/users/eab3fb25879b46469011f5b04026cbc5/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:16.802104 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.802604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.802931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.816690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:16.832993 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] MFA Rules not processed for user `eab3fb25879b46469011f5b04026cbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:16.834290 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:16.898186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1261/2551] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:16.902797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:16.964529 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d46cb6-756b-4901-824e-35b4b5222462 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:16.969620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:16.970272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:16.970556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:16.970833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:16.971545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:16.973432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.000464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1291/2552] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:16 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:17.004888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.015517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfeee9-a2b8-4309-b6ae-878f741784bf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.077704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.078436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.078754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.079066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.079774 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.081696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.102843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1262/2553] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:17 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:17.107432 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.117761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7fe8-2a74-4a7e-8b36-f1bb2d5fc78b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.122365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.123563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.123851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.124130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.124850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.126439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.131649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:17.137616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1292/2554] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:17.142401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.152466 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db86c7-80e3-428e-b0e6-b9ead2bba7b3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.157132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.157998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.158282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.158559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] PATH_INFO: `/v3/projects/6a4b4b8800b64c15be3109bdc099bb56/users/5f468f1b52d3448c834b4a91b4d72595/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.173268 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4b4b8800b64c15be3109bdc099bb56, user_id=5f468f1b52d3448c834b4a91b4d72595, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.175941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.189617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1263/2555] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:17 2022] PUT /identity/v3/projects/6a4b4b8800b64c15be3109bdc099bb56/users/5f468f1b52d3448c834b4a91b4d72595/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:17.193411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.204544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b8190-9789-4b5e-bd32-de28e51b9aa2 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.264080 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23027565-8d4e-484e-bc43-facefcc8fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.264775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027565-8d4e-484e-bc43-facefcc8fb77 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.265047 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027565-8d4e-484e-bc43-facefcc8fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.265329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23027565-8d4e-484e-bc43-facefcc8fb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.266053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23027565-8d4e-484e-bc43-facefcc8fb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.267694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23027565-8d4e-484e-bc43-facefcc8fb77 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.277664 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1293/2556] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:17.281887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.292171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f449b9-d23a-4ca2-bd8e-099c32bea81e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.297357 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.298239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.298524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.298801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] PATH_INFO: `/v3/projects/6a4b4b8800b64c15be3109bdc099bb56/users/5f468f1b52d3448c834b4a91b4d72595/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.300810 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4b4b8800b64c15be3109bdc099bb56, user_id=5f468f1b52d3448c834b4a91b4d72595, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.303492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.314914 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1264/2557] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:17 2022] PUT /identity/v3/projects/6a4b4b8800b64c15be3109bdc099bb56/users/5f468f1b52d3448c834b4a91b4d72595/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:17.324980 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.325275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.325561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.351787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] MFA Rules not processed for user `5f468f1b52d3448c834b4a91b4d72595`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:17.352937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:17.420425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1294/2558] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:17.432639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.485801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:17.489564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fc9ed7-b35b-4a37-b078-e6a9c7a8ff72 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.494387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.495032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.495359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.495643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.504800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.506259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.516264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1265/2559] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:17.820102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.825100 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d7ebb-73b3-46f1-a604-eb6bf7b5f44f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.830422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f468f1b52d3448c834b4a91b4d72595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4b4b8800b64c15be3109bdc099bb56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.831216 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.831511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.831795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.832520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:17.832828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.834395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.851441 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1295/2560] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:17.852570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.862308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154634f-8e31-4cd2-815f-fe84c780db20 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.867276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f468f1b52d3448c834b4a91b4d72595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4b4b8800b64c15be3109bdc099bb56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.867719 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.868022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.868310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.869021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.870917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.899160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1266/2561] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:17 2022] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:17.903125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:17.913649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a95aa-959b-427d-82f1-ea9187421860 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:17.970661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f468f1b52d3448c834b4a91b4d72595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4b4b8800b64c15be3109bdc099bb56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:17.971359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:17.971656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:17.971940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:17.972656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:17.972962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:17.974544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:17.988814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1296/2562] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:18.022980 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:18.034518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9744c5-646d-479c-81aa-1fa68555bf82 tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:18.039630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f468f1b52d3448c834b4a91b4d72595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4b4b8800b64c15be3109bdc099bb56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:18.040491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:18.040784 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:18.041062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] PATH_INFO: `/v3/projects/3552bbef49784f11a3c68d07ce140706` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:18.042255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3552bbef49784f11a3c68d07ce140706)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:18.044368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:18.092188 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3552bbef49784f11a3c68d07ce140706', 'request_id': 'req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.101087 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3552bbef49784f11a3c68d07ce140706', 'request_id': 'req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.115112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3552bbef49784f11a3c68d07ce140706', 'request_id': 'req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.128592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] The token cache is being invalidate because project 3552bbef49784f11a3c68d07ce140706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:18.128888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.129611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07cb77a1-5f4d-4ded-9f45-2aa97f45282c tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.131266 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1267/2563] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:18 2022] DELETE /identity/v3/projects/3552bbef49784f11a3c68d07ce140706 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:18.332205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:18.333938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:18.339410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:18.400831 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0c243-2294-4601-a51d-6d2f444f90ac tempest-VolumeQuotaClassesTest-1957260827 tempest-VolumeQuotaClassesTest-1957260827-project-admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:18.458035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:18.458913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:18.459236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:18.459511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] PATH_INFO: `/v3/users/eab3fb25879b46469011f5b04026cbc5` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:18.460671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab3fb25879b46469011f5b04026cbc5)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:18.462593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:18.508306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab3fb25879b46469011f5b04026cbc5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.515398 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab3fb25879b46469011f5b04026cbc5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.516128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab3fb25879b46469011f5b04026cbc5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.528089 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab3fb25879b46469011f5b04026cbc5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.529260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab3fb25879b46469011f5b04026cbc5'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:18.541264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1297/2564] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:18 2022] DELETE /identity/v3/users/eab3fb25879b46469011f5b04026cbc5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:18.546397 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:18.546718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:18.547003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:18.564794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:18.565989 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:18.626384 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1268/2565] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:18.635849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:18.637264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:18.671542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:18.697906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bffabb-7044-4d72-9b38-ebe7d4e859e7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:18.702114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:18.702758 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:18.703061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:18.703356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:18.712483 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:18.713901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:18.724168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1298/2566] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:18.987796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:18.989341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:19.010223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229c96f-f1a7-4218-941a-e1a49c33aeaf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:19.016187 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:19.017197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.017546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.017828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] PATH_INFO: `/v3/projects/7fdb3ec2f7384f009c779fbf284f25af` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.019024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdb3ec2f7384f009c779fbf284f25af)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:19.020957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:19.066156 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:19.067595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdb3ec2f7384f009c779fbf284f25af', 'request_id': 'req-960ecf76-9fbd-4b6d-9547-589fe35286c6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.075777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdb3ec2f7384f009c779fbf284f25af', 'request_id': 'req-960ecf76-9fbd-4b6d-9547-589fe35286c6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.082846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdb3ec2f7384f009c779fbf284f25af', 'request_id': 'req-960ecf76-9fbd-4b6d-9547-589fe35286c6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.093016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] The token cache is being invalidate because project 7fdb3ec2f7384f009c779fbf284f25af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:19.093585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.093912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.095486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1269/2567] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:18 2022] DELETE /identity/v3/projects/7fdb3ec2f7384f009c779fbf284f25af => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:19.099480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:19.109241 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe042-eb14-49e8-a2d1-3b6f051c72dd service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:19.164730 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:19.165602 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.166188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.166309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] PATH_INFO: `/v3/users/5f468f1b52d3448c834b4a91b4d72595` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.167478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f468f1b52d3448c834b4a91b4d72595)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:19.169405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:19.217901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f468f1b52d3448c834b4a91b4d72595'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.225821 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f468f1b52d3448c834b4a91b4d72595'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.226374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f468f1b52d3448c834b4a91b4d72595'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.243171 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f468f1b52d3448c834b4a91b4d72595'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.243920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-d1effe54-d901-4576-ba60-a7b714da7091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f468f1b52d3448c834b4a91b4d72595'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.257467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1299/2568] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:19 2022] DELETE /identity/v3/users/5f468f1b52d3448c834b4a91b4d72595 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:19.552067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:19.556736 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:19.580766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ecf76-9fbd-4b6d-9547-589fe35286c6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:19.639292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:19.640159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.640443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.640717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] PATH_INFO: `/v3/projects/6a4b4b8800b64c15be3109bdc099bb56` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.641895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4b4b8800b64c15be3109bdc099bb56)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:19.643821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:19.689334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4b4b8800b64c15be3109bdc099bb56', 'request_id': 'req-dd97f0c5-8f40-4029-b7df-738730e3f085'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.696430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4b4b8800b64c15be3109bdc099bb56', 'request_id': 'req-dd97f0c5-8f40-4029-b7df-738730e3f085'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.702629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4b4b8800b64c15be3109bdc099bb56', 'request_id': 'req-dd97f0c5-8f40-4029-b7df-738730e3f085'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.713416 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] The token cache is being invalidate because project 6a4b4b8800b64c15be3109bdc099bb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:19.713650 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.714288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dd97f0c5-8f40-4029-b7df-738730e3f085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:19.715904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1270/2569] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:19 2022] DELETE /identity/v3/projects/6a4b4b8800b64c15be3109bdc099bb56 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:19.721188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.721493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.721781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.740037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:19.741248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:19.785347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:19.802520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1300/2570] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:19.812587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.812883 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.813170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.831673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:19.832878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:19.843615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1271/2571] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:19.847931 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:19.858574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cff89-32b6-455e-bc77-bed6c89bf8b6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:19.863747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:19.864696 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.864997 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.865307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.866172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:19.866545 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:19.868205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:19.879991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1301/2572] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:19.884186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:19.893388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c2f95-d045-40f0-86ec-6b5f2f9d730d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:19.898055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:19.898730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.899027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:19.899339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:19.900043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:19.901957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:19.931432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1272/2573] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:19 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:19.932587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:19.942829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c6913-1ca8-40e5-bf34-153abbf367e3 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:19.998891 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:19.999522 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:19.999818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.000105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.000799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.002800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.022520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1302/2574] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:19 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:20.026580 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.037311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a53e4-91e2-42dc-b8cc-ca9b96a92a9e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.041917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.042568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.042859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.043176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.043900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.046117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.057326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1273/2575] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:20.061124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.071246 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555f308-3c64-4059-8690-a9a9ea096094 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.075789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05403070-9719-468d-9500-7fe6b3b3c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.076440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403070-9719-468d-9500-7fe6b3b3c856 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.076727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403070-9719-468d-9500-7fe6b3b3c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.077007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403070-9719-468d-9500-7fe6b3b3c856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.077724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403070-9719-468d-9500-7fe6b3b3c856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.079329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403070-9719-468d-9500-7fe6b3b3c856 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.089141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1303/2576] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:20.093526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.103554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfe96-4d8d-43b0-99c5-dbc961c99344 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.109012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.109887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.110182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.110464 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] PATH_INFO: `/v3/projects/a6da23cc62bd48f5b80b13a98ddcb6c0/users/804e04dcdd2b479b98dd0bc5fb433a79/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.125209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6da23cc62bd48f5b80b13a98ddcb6c0, user_id=804e04dcdd2b479b98dd0bc5fb433a79, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.127911 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.140220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1274/2577] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:20 2022] PUT /identity/v3/projects/a6da23cc62bd48f5b80b13a98ddcb6c0/users/804e04dcdd2b479b98dd0bc5fb433a79/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:20.150396 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.150898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.150995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.183629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] MFA Rules not processed for user `804e04dcdd2b479b98dd0bc5fb433a79`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:20.184843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:20.247647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1304/2578] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:20.252157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.256576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:20.315025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a583ff-aa2b-4945-bc57-384e400f7ec5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.319588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.320236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.320521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.320798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.321480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.323432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.348672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1275/2579] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:20 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:20.352826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.363374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7ecc-e381-4cba-888b-4ebb79c0bc1d None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.406805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:20.420818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.421497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.421793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.422073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.422759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.424777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.443948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1305/2580] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:20 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:20.448075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.458709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7a818-20eb-4338-b3a4-2ef393adf9ad admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.463337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.463985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.464270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.464542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.465254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.467491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.478247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1276/2581] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:20.482490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.492913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8266be5-ba69-4f25-b8ed-4a71445aca37 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.497741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.498614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.498906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.499225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] PATH_INFO: `/v3/projects/778936c5d1504daca55a6440e30dc593/users/a62eb6b40cc145abbd888e776651fa53/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.514479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778936c5d1504daca55a6440e30dc593, user_id=a62eb6b40cc145abbd888e776651fa53, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.517379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.530979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1306/2582] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:20 2022] PUT /identity/v3/projects/778936c5d1504daca55a6440e30dc593/users/a62eb6b40cc145abbd888e776651fa53/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:20.534955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.545113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f60123-3f6e-42ec-be47-37c0216f6ee6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.602770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52702e5f-7278-4cf2-adb4-9ed4eb0335c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.603815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702e5f-7278-4cf2-adb4-9ed4eb0335c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.603815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702e5f-7278-4cf2-adb4-9ed4eb0335c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.604065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52702e5f-7278-4cf2-adb4-9ed4eb0335c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.604745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52702e5f-7278-4cf2-adb4-9ed4eb0335c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.606337 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52702e5f-7278-4cf2-adb4-9ed4eb0335c8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.619930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1277/2583] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:20.621137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.632503 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a1de2-a625-49bd-bc02-b10aded84e27 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.637263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.638203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.639091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.639388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] PATH_INFO: `/v3/projects/778936c5d1504daca55a6440e30dc593/users/a62eb6b40cc145abbd888e776651fa53/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.641353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778936c5d1504daca55a6440e30dc593, user_id=a62eb6b40cc145abbd888e776651fa53, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.644048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.654749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1307/2584] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:20 2022] PUT /identity/v3/projects/778936c5d1504daca55a6440e30dc593/users/a62eb6b40cc145abbd888e776651fa53/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:20.665120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.665491 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.665861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.693239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] MFA Rules not processed for user `a62eb6b40cc145abbd888e776651fa53`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:20.694423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:20.757637 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:20.765419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1278/2585] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:20.774312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.776151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:20.840220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d89a9-16ea-48e3-ae2a-ae2608213a86 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.844699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.845351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.845638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.845923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.855205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.856635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:20.873514 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1308/2586] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:20.912366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:20.922676 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7805d4-9afc-42fb-ad20-346155d92c6d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:20.926320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d981-2143-410f-85fa-a976edaabd0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:20.926955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d981-2143-410f-85fa-a976edaabd0d service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:20.927274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d981-2143-410f-85fa-a976edaabd0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:20.927563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d981-2143-410f-85fa-a976edaabd0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:20.985619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d981-2143-410f-85fa-a976edaabd0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:20.986997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d981-2143-410f-85fa-a976edaabd0d service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:21.000411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1279/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:24.281066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:24.342935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500b46-4a3a-44f5-bdc9-0effcc4a5477 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:24.347984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:24.348850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:24.349141 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:24.349420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] PATH_INFO: `/v3/users/804e04dcdd2b479b98dd0bc5fb433a79` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:24.350604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804e04dcdd2b479b98dd0bc5fb433a79)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:24.352642 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:24.395977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:24.398925 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804e04dcdd2b479b98dd0bc5fb433a79'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.407330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804e04dcdd2b479b98dd0bc5fb433a79'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.408037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804e04dcdd2b479b98dd0bc5fb433a79'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.420149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804e04dcdd2b479b98dd0bc5fb433a79'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.420807 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804e04dcdd2b479b98dd0bc5fb433a79'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.433478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1309/2588] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:24 2022] DELETE /identity/v3/users/804e04dcdd2b479b98dd0bc5fb433a79 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:24.438234 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:24.438839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:24.438839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:24.455939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:24.457165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:24.514124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1280/2589] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:24.523962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:24.525428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:24.582719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db9ed7-8b3d-429c-83d7-af9bc6c9eb71 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:24.586322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:24.586957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:24.587285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:24.587552 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:24.596417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:24.597832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:24.607178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1310/2590] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:24.861769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:24.863306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:24.868310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:24.869756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:24.876028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c04d5-4f52-44ad-818d-634eacb1e4c7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:24.881561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:24.882602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:24.882894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:24.883223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] PATH_INFO: `/v3/users/18b308320e23413b9c196a9b91a04a3b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:24.884658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18b308320e23413b9c196a9b91a04a3b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:24.884795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6aee2-2280-4f9f-a5a6-e32e6b2211c7 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:24.886862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:24.889464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:24.890940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:24.891325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:24.891659 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] PATH_INFO: `/v3/projects/a6da23cc62bd48f5b80b13a98ddcb6c0` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:24.892940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6da23cc62bd48f5b80b13a98ddcb6c0)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:24.894905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:24.939737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18b308320e23413b9c196a9b91a04a3b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.946893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6da23cc62bd48f5b80b13a98ddcb6c0', 'request_id': 'req-182bd304-eab2-4f84-b92f-e08d33010c33'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.947073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18b308320e23413b9c196a9b91a04a3b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.955601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6da23cc62bd48f5b80b13a98ddcb6c0', 'request_id': 'req-182bd304-eab2-4f84-b92f-e08d33010c33'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.960587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18b308320e23413b9c196a9b91a04a3b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.961369 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18b308320e23413b9c196a9b91a04a3b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.962213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6da23cc62bd48f5b80b13a98ddcb6c0', 'request_id': 'req-182bd304-eab2-4f84-b92f-e08d33010c33'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.969299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8085685d-8c9d-4782-822f-44eb87af164a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18b308320e23413b9c196a9b91a04a3b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.973482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] The token cache is being invalidate because project a6da23cc62bd48f5b80b13a98ddcb6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:24.973774 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.974403 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:24.975302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1281/2591] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:24 2022] DELETE /identity/v3/users/18b308320e23413b9c196a9b91a04a3b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:24.975941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1311/2592] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:24 2022] DELETE /identity/v3/projects/a6da23cc62bd48f5b80b13a98ddcb6c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:24.979473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:24.979767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:24.980080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:24.981590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:24.982862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:24.998411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:25.000123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.003972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:25.033143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:25.050541 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bd304-eab2-4f84-b92f-e08d33010c33 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.065080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1282/2593] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:25.074762 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.076121 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.107231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.108108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.108393 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.108690 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] PATH_INFO: `/v3/users/a62eb6b40cc145abbd888e776651fa53` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.109877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62eb6b40cc145abbd888e776651fa53)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.111883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.134001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881602a-25c4-4491-b332-da1fb2988b55 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.139088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.139744 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.140591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.140881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.152001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.153454 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.163643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62eb6b40cc145abbd888e776651fa53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.167818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1283/2594] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:25.174959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62eb6b40cc145abbd888e776651fa53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.175737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62eb6b40cc145abbd888e776651fa53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.189854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62eb6b40cc145abbd888e776651fa53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.190810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62eb6b40cc145abbd888e776651fa53'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.205277 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1312/2595] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:24 2022] DELETE /identity/v3/users/a62eb6b40cc145abbd888e776651fa53 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:25.449310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.451006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.477092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a550-11fe-49d3-b7eb-88163ddbe86d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.495649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.497169 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.548786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.550114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.550480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.550769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] PATH_INFO: `/v3/projects/a481805dcb7042568d877139d145e2a3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.552045 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a481805dcb7042568d877139d145e2a3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.554063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.570889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da432c96-4038-41c7-ac8e-bfa53c9c97e1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.575586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.576587 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.576945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.577295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] PATH_INFO: `/v3/projects/778936c5d1504daca55a6440e30dc593` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.578570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=778936c5d1504daca55a6440e30dc593)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.580591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.597827 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:25.601338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a481805dcb7042568d877139d145e2a3', 'request_id': 'req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.605259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:25.610816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a481805dcb7042568d877139d145e2a3', 'request_id': 'req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.618850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a481805dcb7042568d877139d145e2a3', 'request_id': 'req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.631452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] The token cache is being invalidate because project a481805dcb7042568d877139d145e2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:25.631956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.632731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9dfcf14-2645-41aa-a4d7-83d3433c0caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.634302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1284/2596] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:25 2022] DELETE /identity/v3/projects/a481805dcb7042568d877139d145e2a3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:25.638623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778936c5d1504daca55a6440e30dc593', 'request_id': 'req-46e977cd-7850-434d-a749-8551851224ac'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.639032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7d33-8ccf-4be1-bb3d-87854ea9cb87 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.639347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7d33-8ccf-4be1-bb3d-87854ea9cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.639626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7d33-8ccf-4be1-bb3d-87854ea9cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.648652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778936c5d1504daca55a6440e30dc593', 'request_id': 'req-46e977cd-7850-434d-a749-8551851224ac'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.656230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778936c5d1504daca55a6440e30dc593', 'request_id': 'req-46e977cd-7850-434d-a749-8551851224ac'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.659198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-017c7d33-8ccf-4be1-bb3d-87854ea9cb87 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:25.660417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-017c7d33-8ccf-4be1-bb3d-87854ea9cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.666635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] The token cache is being invalidate because project 778936c5d1504daca55a6440e30dc593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:25.666929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.667605 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-46e977cd-7850-434d-a749-8551851224ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:25.669162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1313/2597] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:25 2022] DELETE /identity/v3/projects/778936c5d1504daca55a6440e30dc593 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:25.675673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a580-00b9-4f31-991d-41ad78c4d922 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.676043 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a580-00b9-4f31-991d-41ad78c4d922 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.676332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a580-00b9-4f31-991d-41ad78c4d922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.694663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-08a7a580-00b9-4f31-991d-41ad78c4d922 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:25.696540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-08a7a580-00b9-4f31-991d-41ad78c4d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.722830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1285/2598] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:25.731904 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.732201 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.732534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.749831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:25.751025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.758857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1286/2599] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:25.761511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1314/2600] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:25.764543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.769327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.769637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.769914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.774355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5f6b-fd7d-44d8-b7ed-ac4555b98b19 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.779301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.779944 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.780228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.780625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.781862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:25.782172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.783799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.788136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:25.789327 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:25.798972 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1287/2601] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:25.799166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1315/2602] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:25.799992 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.801510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.809895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ba208-3144-4de9-9601-e9b97fdfa1d2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.810575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394bc48-0af0-45f5-98b3-462b0f5a10fc None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.815225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.815861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.816102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.816252 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.816414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.816743 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.817035 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.817133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.817323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.818057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:25.818372 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.818987 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.820532 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.837713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1316/2603] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:24:25.842592 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.848692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1288/2604] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:25.852670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.854184 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f55c8e-5c00-4cf2-884b-3f769441231f admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.913027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.913894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.914185 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.914468 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.915262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.916842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f16af-484e-4728-a53b-a78a123a9d7b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.917299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.921854 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:25.922544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:25.922830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:25.923141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:25.923823 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:25.925780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:25.945995 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1289/2605] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:25.949912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.953639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1317/2606] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:25.954486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:25.960264 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c74449-ea4e-4d16-858c-a99b31386e73 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:25.964013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:25.992338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:26.022089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.022923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.023309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.023667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.024473 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.025377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408132f4-52ee-48b9-b68b-bb1f5b62fa7d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.026251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.030033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.030725 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.031020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.031329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.032009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.033907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.036668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1290/2607] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:26.040490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.051024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0c89d-8899-4517-acb1-5ae45a5b6c43 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.054437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1318/2608] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:25 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:26.055940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.056598 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.056899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.057273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.058000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.058542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.059655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.070193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e70495-f0ea-440c-b18a-cfd625e0336a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.070408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1291/2609] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:26.074350 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.075641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.076320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.076614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.076879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.078215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.079823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.084850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a58f-bebc-4f9d-9742-eb7ee9528d2f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.089452 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.092857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1319/2610] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:26.093626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.093626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.093626 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] PATH_INFO: `/v3/projects/59b595a5f81c4d01a7d9c02d576327a2/users/bffec2e393ab40c290ecd72c954b6f9c/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.094167 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.104237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d0276-12df-4cef-a2e7-677ffcd4d6d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.106152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b595a5f81c4d01a7d9c02d576327a2, user_id=bffec2e393ab40c290ecd72c954b6f9c, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.109449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.109581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841d36e-5eb3-417d-b576-b7dc244ceea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.110081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d36e-5eb3-417d-b576-b7dc244ceea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.110364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d36e-5eb3-417d-b576-b7dc244ceea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.110645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841d36e-5eb3-417d-b576-b7dc244ceea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.111387 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d36e-5eb3-417d-b576-b7dc244ceea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.112990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841d36e-5eb3-417d-b576-b7dc244ceea6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.124225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1292/2611] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:26 2022] PUT /identity/v3/projects/59b595a5f81c4d01a7d9c02d576327a2/users/bffec2e393ab40c290ecd72c954b6f9c/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:26.127828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1320/2612] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:26.128985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.134994 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.135325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.135862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.162943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] MFA Rules not processed for user `bffec2e393ab40c290ecd72c954b6f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:26.164298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:26.193732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1751d02-76a6-472b-a314-86b57251a978 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.203217 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b1a3-41ba-42d3-9bf0-fb3f8ac4ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.204113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b1a3-41ba-42d3-9bf0-fb3f8ac4ace4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.204425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b1a3-41ba-42d3-9bf0-fb3f8ac4ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.204701 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b1a3-41ba-42d3-9bf0-fb3f8ac4ace4 admin admin] PATH_INFO: `/v3/projects/4463679864df49aa8bebb0a013939517/users/0afdbc9e0fb04733ab1a1db67528120f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.220061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b1a3-41ba-42d3-9bf0-fb3f8ac4ace4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4463679864df49aa8bebb0a013939517, user_id=0afdbc9e0fb04733ab1a1db67528120f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.222723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b1a3-41ba-42d3-9bf0-fb3f8ac4ace4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.232088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1321/2613] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:26.236511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.238510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1293/2614] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:26 2022] PUT /identity/v3/projects/4463679864df49aa8bebb0a013939517/users/0afdbc9e0fb04733ab1a1db67528120f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:26.246843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a4c68-5856-40e8-bbaa-2b6d36d2f3ae None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.248563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.248932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.249414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.275359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] MFA Rules not processed for user `0afdbc9e0fb04733ab1a1db67528120f`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:26.276678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:26.305088 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.305761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.306053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.306344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.307055 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.308964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.319783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:26.339152 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1322/2615] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:26 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:26.340844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.346763 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1294/2616] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:26.357686 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.359113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:26.365829 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:26.404007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd125572-0bac-45b9-bd9e-40ce4fcbee08 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.410038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.410712 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.411001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.411318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.412007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.413915 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.420042 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc0bb-ddcc-4f6b-b4af-a8402ba0f331 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.438376 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1323/2617] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:26 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:26.439446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.448912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cb8d-05c1-4de9-8251-637395dfb1ca admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.453559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.454194 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.454482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.454902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.455676 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.457303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.467415 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1324/2618] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:26.471178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.471671 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.471828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.472111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.472390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.481155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11ace9-ec10-4c04-a319-3e2cf7700777 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.486693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.487657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.487959 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.488236 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] PATH_INFO: `/v3/projects/2f017d4ea73c4f879b09fdfd647c0b95/users/ecf4bfb5298e45e3bbace89d52095355/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.503893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f017d4ea73c4f879b09fdfd647c0b95, user_id=ecf4bfb5298e45e3bbace89d52095355, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.506504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.519311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1325/2619] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:26 2022] PUT /identity/v3/projects/2f017d4ea73c4f879b09fdfd647c0b95/users/ecf4bfb5298e45e3bbace89d52095355/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:26.523198 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.529918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.531962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.541218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1295/2620] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:26.586938 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82def2c-f239-446a-b683-c528a6164fa6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.592054 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d552d-ccd0-4d03-8579-0c5ee5a13816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.592677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d552d-ccd0-4d03-8579-0c5ee5a13816 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.592966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d552d-ccd0-4d03-8579-0c5ee5a13816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.593826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d552d-ccd0-4d03-8579-0c5ee5a13816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.594573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d552d-ccd0-4d03-8579-0c5ee5a13816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.596251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d552d-ccd0-4d03-8579-0c5ee5a13816 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.611366 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1326/2621] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:26.612659 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.624100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc73d1-15d5-4f28-baa5-6e90a2722254 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.630218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.631342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.631708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.632065 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] PATH_INFO: `/v3/projects/2f017d4ea73c4f879b09fdfd647c0b95/users/ecf4bfb5298e45e3bbace89d52095355/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.634521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f017d4ea73c4f879b09fdfd647c0b95, user_id=ecf4bfb5298e45e3bbace89d52095355, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.637444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.649844 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1296/2622] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:26 2022] PUT /identity/v3/projects/2f017d4ea73c4f879b09fdfd647c0b95/users/ecf4bfb5298e45e3bbace89d52095355/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:26.661773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.662162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.662515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.692274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] MFA Rules not processed for user `ecf4bfb5298e45e3bbace89d52095355`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:26.693511 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:26.726322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:26.770228 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1327/2623] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:26.781237 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.783133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:26.843833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361499c6-549d-47da-8a2c-8d0c0a870a28 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.847693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d147162-6846-41df-8482-767e2192713f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.848345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d147162-6846-41df-8482-767e2192713f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.848638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d147162-6846-41df-8482-767e2192713f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.848924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d147162-6846-41df-8482-767e2192713f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.858374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d147162-6846-41df-8482-767e2192713f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.860000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d147162-6846-41df-8482-767e2192713f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:26.872184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1297/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:26.904651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:26.979787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53ae05-f442-4a83-a6b7-2f88e4535c72 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:26.986631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:26.991470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:26.991772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:26.992068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] PATH_INFO: `/v3/users/bffec2e393ab40c290ecd72c954b6f9c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:26.993535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffec2e393ab40c290ecd72c954b6f9c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:26.995599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:27.048882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffec2e393ab40c290ecd72c954b6f9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.055785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffec2e393ab40c290ecd72c954b6f9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.056405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffec2e393ab40c290ecd72c954b6f9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.069009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffec2e393ab40c290ecd72c954b6f9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.069643 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffec2e393ab40c290ecd72c954b6f9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.082227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1328/2625] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:26 2022] DELETE /identity/v3/users/bffec2e393ab40c290ecd72c954b6f9c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:27.086691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:27.086990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:27.087329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:27.094565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:27.105879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:27.107184 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:27.165644 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1298/2626] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:27.175627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:27.177031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:27.228722 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:27.236155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d89fab-d0ab-4e01-b33a-ab9afb2e8cbb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:27.240874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:27.241879 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:27.242196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:27.242481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:27.252385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:27.253847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:27.263876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1329/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:27.536494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:27.537956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:27.551182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc4cb0-0c2f-4ab0-9fb1-2230350961f7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:27.557313 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:27.558282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:27.558567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:27.558849 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] PATH_INFO: `/v3/projects/59b595a5f81c4d01a7d9c02d576327a2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:27.560078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b595a5f81c4d01a7d9c02d576327a2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:27.562288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:27.611269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b595a5f81c4d01a7d9c02d576327a2', 'request_id': 'req-959f63b6-8e15-4622-94f8-50730244df42'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.618613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b595a5f81c4d01a7d9c02d576327a2', 'request_id': 'req-959f63b6-8e15-4622-94f8-50730244df42'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.625425 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b595a5f81c4d01a7d9c02d576327a2', 'request_id': 'req-959f63b6-8e15-4622-94f8-50730244df42'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.635564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] The token cache is being invalidate because project 59b595a5f81c4d01a7d9c02d576327a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:27.635852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.636480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.638008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1299/2628] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:27 2022] DELETE /identity/v3/projects/59b595a5f81c4d01a7d9c02d576327a2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:27.642578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:27.652117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277afa5-8ab5-4a44-913e-0f1888fc2d6b service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:27.707422 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:27.708286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:27.708571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:27.708847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] PATH_INFO: `/v3/users/ecf4bfb5298e45e3bbace89d52095355` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:27.710145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf4bfb5298e45e3bbace89d52095355)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:27.712163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:27.757661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf4bfb5298e45e3bbace89d52095355'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.764738 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf4bfb5298e45e3bbace89d52095355'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.765405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf4bfb5298e45e3bbace89d52095355'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.777084 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf4bfb5298e45e3bbace89d52095355'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.777706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-8ed4874e-9699-43e2-b6d7-3521d09fb209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf4bfb5298e45e3bbace89d52095355'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:27.793580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1330/2629] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:27 2022] DELETE /identity/v3/users/ecf4bfb5298e45e3bbace89d52095355 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:28.058707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.060220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:28.074710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f63b6-8e15-4622-94f8-50730244df42 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.145657 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.146555 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.146842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.147152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] PATH_INFO: `/v3/projects/2f017d4ea73c4f879b09fdfd647c0b95` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.148346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f017d4ea73c4f879b09fdfd647c0b95)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.150273 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.188283 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:28.220568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f017d4ea73c4f879b09fdfd647c0b95', 'request_id': 'req-2c4ab58a-df91-4c12-a9bd-2112bf066c10'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:28.232499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f017d4ea73c4f879b09fdfd647c0b95', 'request_id': 'req-2c4ab58a-df91-4c12-a9bd-2112bf066c10'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:28.239140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f017d4ea73c4f879b09fdfd647c0b95', 'request_id': 'req-2c4ab58a-df91-4c12-a9bd-2112bf066c10'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:28.250433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] The token cache is being invalidate because project 2f017d4ea73c4f879b09fdfd647c0b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:28.250718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:28.251423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2c4ab58a-df91-4c12-a9bd-2112bf066c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:28.252991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1300/2630] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:28 2022] DELETE /identity/v3/projects/2f017d4ea73c4f879b09fdfd647c0b95 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:28.257793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.258081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.258359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.276573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:28.277756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:28.335784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1331/2631] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:28.343979 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.344270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.344551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.364655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:28.365867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:28.374012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1301/2632] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:28.378193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.387844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c8fc4-7ff3-4679-9b6b-eb8a1e97b2e8 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.393091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.393857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.394148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.394431 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.395203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:28.395593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.397497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.400362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:28.412551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1332/2633] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:28.417149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.427001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e0925-d5e1-433f-bca5-70f253c0921a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.431808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.432458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.432771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.433053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.433750 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.435694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.464504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1302/2634] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:28.465604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.478209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f20bb-dc64-4138-a19a-8df3b18240c9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.534457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.535156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.535453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.535741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.536439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.538353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.557798 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1333/2635] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:28.562197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.572428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a9aa2-087a-452b-824d-6f5980fd2ab7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.577019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.578175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.578465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.578746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.579518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.581120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.591318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1303/2636] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:28.595694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.605547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29823f10-4c36-41ad-a5fa-17559e6c7185 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.610689 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e6a8e-6640-4b12-b35a-b4b8a915ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.611389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6a8e-6640-4b12-b35a-b4b8a915ae46 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.611685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6a8e-6640-4b12-b35a-b4b8a915ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.611968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6a8e-6640-4b12-b35a-b4b8a915ae46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.612691 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e6a8e-6640-4b12-b35a-b4b8a915ae46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.614294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e6a8e-6640-4b12-b35a-b4b8a915ae46 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.624243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1334/2637] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:28.628867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.638865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475a63f-1b5a-4a37-b6c1-d32980c88f5f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.643558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.644421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.644706 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.644983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] PATH_INFO: `/v3/projects/58789fcd62714fcb85d8031f654e9840/users/24de1d72abfe4c73824abd110f888f8e/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.659315 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=58789fcd62714fcb85d8031f654e9840, user_id=24de1d72abfe4c73824abd110f888f8e, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.661900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.674495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1304/2638] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:28 2022] PUT /identity/v3/projects/58789fcd62714fcb85d8031f654e9840/users/24de1d72abfe4c73824abd110f888f8e/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:28.684542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.685022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.685117 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.711861 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] MFA Rules not processed for user `24de1d72abfe4c73824abd110f888f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:28.713052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:28.777126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1335/2639] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:28.782018 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.847860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcc302-61d6-4f71-8aa6-fa21a2f78bbe admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.853150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.853817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.854105 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.854387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.855117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.857030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.882658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1305/2640] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:28.886794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.897517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b0171-bfc2-437b-add7-b1bdd24141ee None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:28.955805 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:28.956395 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:28.956680 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:28.956958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:28.957644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:28.959574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:28.967822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:28.981844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1336/2641] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:28 2022] POST /identity/v3/users => generated 310 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:28.984140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:28.994629 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be02b3a-9b36-443c-a65c-551848afcf35 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:29.000690 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:29.001352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.001640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.001921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.002711 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:29.004288 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:29.014963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1306/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:29.020009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:29.029862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051e16-4586-4b64-945c-1b78a70c5549 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:29.035060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:29.035943 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.036229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.036508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] PATH_INFO: `/v3/projects/651fc21d70ad41f5a8a6884ae994300a/users/11ead487020a43b8a76abd5d03022083/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.052074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=651fc21d70ad41f5a8a6884ae994300a, user_id=11ead487020a43b8a76abd5d03022083, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:29.054702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:29.067970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1337/2643] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:29 2022] PUT /identity/v3/projects/651fc21d70ad41f5a8a6884ae994300a/users/11ead487020a43b8a76abd5d03022083/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:29.071828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:29.081614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed7e5a-d380-435c-961b-2af5cea1f46f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:29.106877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:29.138897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87233a-ad9f-4beb-b479-3f20deff0da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:29.139591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87233a-ad9f-4beb-b479-3f20deff0da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.140426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87233a-ad9f-4beb-b479-3f20deff0da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.140716 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87233a-ad9f-4beb-b479-3f20deff0da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.141437 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87233a-ad9f-4beb-b479-3f20deff0da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:29.143061 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87233a-ad9f-4beb-b479-3f20deff0da9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:29.152928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1307/2644] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:29.157660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:29.172377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d0da9-fe18-48f3-b9ec-afd49abe0aba admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:29.179409 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:29.180293 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.180581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.180860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] PATH_INFO: `/v3/projects/651fc21d70ad41f5a8a6884ae994300a/users/11ead487020a43b8a76abd5d03022083/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.182834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=651fc21d70ad41f5a8a6884ae994300a, user_id=11ead487020a43b8a76abd5d03022083, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:29.185457 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:29.196052 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1338/2645] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:29 2022] PUT /identity/v3/projects/651fc21d70ad41f5a8a6884ae994300a/users/11ead487020a43b8a76abd5d03022083/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:29.207773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.208073 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.208418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.235391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] MFA Rules not processed for user `11ead487020a43b8a76abd5d03022083`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:29.236585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:29.312739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1308/2646] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:29.324833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:29.325721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:29.387354 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf49378-fefa-436b-8f59-6123c9b7a983 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:29.391847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:29.392492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.392776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.393059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.403472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:29.404900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:29.415365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1339/2647] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:29 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:29.570219 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:29.579793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf7f3e-0452-4a7e-926a-15242055d2cf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:29.583509 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281274-d953-43d1-9ac9-d4652b540ccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:29.584150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281274-d953-43d1-9ac9-d4652b540ccc service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:29.584441 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281274-d953-43d1-9ac9-d4652b540ccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:29.584723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281274-d953-43d1-9ac9-d4652b540ccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:29.645075 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281274-d953-43d1-9ac9-d4652b540ccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:29.646517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281274-d953-43d1-9ac9-d4652b540ccc service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:29.656895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1309/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:32.022248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:32.023639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:32.087653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6b43-aeec-41f4-96cb-c95f436429ff service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:32.092193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:32.094033 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.094324 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.094606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] PATH_INFO: `/v3/users/0afdbc9e0fb04733ab1a1db67528120f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.095803 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0afdbc9e0fb04733ab1a1db67528120f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:32.097750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:32.142735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0afdbc9e0fb04733ab1a1db67528120f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.149673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0afdbc9e0fb04733ab1a1db67528120f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.150291 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0afdbc9e0fb04733ab1a1db67528120f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.155488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:32.164011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0afdbc9e0fb04733ab1a1db67528120f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.164714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0afdbc9e0fb04733ab1a1db67528120f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.178322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1340/2649] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:32 2022] DELETE /identity/v3/users/0afdbc9e0fb04733ab1a1db67528120f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:32.182930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.183427 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.183648 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.203001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:32.204222 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:32.251373 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:32.268585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1310/2650] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:32.278678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:32.280620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:32.341863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f56944-a131-425c-9feb-5c9358e3dbec admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:32.345634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc47d13-64e1-423a-b1dd-946bd1d53eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:32.346286 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc47d13-64e1-423a-b1dd-946bd1d53eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.346575 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc47d13-64e1-423a-b1dd-946bd1d53eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.346857 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc47d13-64e1-423a-b1dd-946bd1d53eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.356015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc47d13-64e1-423a-b1dd-946bd1d53eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:32.357426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc47d13-64e1-423a-b1dd-946bd1d53eb5 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:32.367238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1341/2651] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:32.728191 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:32.729756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:32.743394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e330d-03ad-4ddc-8f0c-d8eee63ff0b7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:32.748800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:32.749183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.750012 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.750299 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] PATH_INFO: `/v3/projects/4463679864df49aa8bebb0a013939517` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.751576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4463679864df49aa8bebb0a013939517)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:32.753480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:32.802877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4463679864df49aa8bebb0a013939517', 'request_id': 'req-76e659de-5d64-483e-82ac-f2d6795cbcf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.810692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4463679864df49aa8bebb0a013939517', 'request_id': 'req-76e659de-5d64-483e-82ac-f2d6795cbcf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.817985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4463679864df49aa8bebb0a013939517', 'request_id': 'req-76e659de-5d64-483e-82ac-f2d6795cbcf8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.829231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] The token cache is being invalidate because project 4463679864df49aa8bebb0a013939517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:32.829554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.830297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76e659de-5d64-483e-82ac-f2d6795cbcf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:32.832053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1311/2652] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:32 2022] DELETE /identity/v3/projects/4463679864df49aa8bebb0a013939517 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:32.838509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.838905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.839430 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.859237 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:32.860439 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:32.918957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1342/2653] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:32.928430 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.928717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.928994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.946923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:32.948114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:32.956226 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1312/2654] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:32.960254 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:32.970179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440d5e-8ac7-462b-bc3a-60e1e0debc1c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:32.974629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:32.975309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:32.975597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:32.975882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:32.976599 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:32.976906 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:32.978479 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:32.995768 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1343/2655] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:32.997317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:33.008142 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9541648-fd66-4779-9296-d709255d9a0d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:33.012868 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:33.013534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.013824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.014106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.014816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:33.016861 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:33.045505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1313/2656] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:32 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:33.048181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:33.058793 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cefde-ec23-41b5-9aa1-ad80479eab6b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:33.116638 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:33.117322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.117608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.117894 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.118630 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:33.120578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:33.136896 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:33.143946 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1344/2657] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:33 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:33.147551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:33.159062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25375786-59d5-4c4c-9792-1e1b57e902ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:33.164876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:33.165735 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.166033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.166318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.167083 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:33.168878 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:33.180139 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1314/2658] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:33.184215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:33.194897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1e5f-e1f1-4126-97f5-5de84f3101c7 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:33.199519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114d178-8b9d-4578-9bec-b54971cb52a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:33.200182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114d178-8b9d-4578-9bec-b54971cb52a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.200470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114d178-8b9d-4578-9bec-b54971cb52a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.200750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114d178-8b9d-4578-9bec-b54971cb52a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.201498 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114d178-8b9d-4578-9bec-b54971cb52a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:33.203454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114d178-8b9d-4578-9bec-b54971cb52a7 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:33.215505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1345/2659] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:33.221248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:33.231877 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849a783-eb2b-490e-b1a1-2591470992e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:33.237262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:33.238196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.238480 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.238756 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] PATH_INFO: `/v3/projects/2d36ce56fac64a56b1f0d9d3f30ca10f/users/9170df0310144cd6945bab5ee3b01b03/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.253500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d36ce56fac64a56b1f0d9d3f30ca10f, user_id=9170df0310144cd6945bab5ee3b01b03, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:33.256333 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:33.269436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1315/2660] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:33 2022] PUT /identity/v3/projects/2d36ce56fac64a56b1f0d9d3f30ca10f/users/9170df0310144cd6945bab5ee3b01b03/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:33.279604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.279900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.280190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.312108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] MFA Rules not processed for user `9170df0310144cd6945bab5ee3b01b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:33.313114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:33.379444 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1346/2661] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:33.391511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:33.393331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:33.451412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200a48-cea6-4e83-ab4a-4114dc64c453 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:33.455623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0de26-e70c-457a-a5c7-e96fd7225308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:33.456277 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0de26-e70c-457a-a5c7-e96fd7225308 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:33.456567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0de26-e70c-457a-a5c7-e96fd7225308 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:33.456864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0de26-e70c-457a-a5c7-e96fd7225308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:33.465485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0de26-e70c-457a-a5c7-e96fd7225308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:33.467085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0de26-e70c-457a-a5c7-e96fd7225308 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:33.476797 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1316/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:34.964058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:34.965565 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:35.050855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9c7d4-d1ef-410a-b5e6-be7c935f6369 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:35.055433 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:35.056322 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:35.056614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:35.056904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] PATH_INFO: `/v3/users/24de1d72abfe4c73824abd110f888f8e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:35.058101 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24de1d72abfe4c73824abd110f888f8e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:35.060059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:35.146130 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24de1d72abfe4c73824abd110f888f8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.162282 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24de1d72abfe4c73824abd110f888f8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.163489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24de1d72abfe4c73824abd110f888f8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.215000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24de1d72abfe4c73824abd110f888f8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.217143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24de1d72abfe4c73824abd110f888f8e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.227173 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:35.247338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1347/2663] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:34 2022] DELETE /identity/v3/users/24de1d72abfe4c73824abd110f888f8e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:35.248856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:35.249912 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:35.250134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:35.275282 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:35.276520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:35.286625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:35.379976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1317/2664] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:35.390635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:35.392108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:35.452105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3482a-9e43-446e-a270-6220338706a5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:35.456542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:35.457221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:35.457530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:35.457808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:35.467687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:35.469413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:35.481215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1348/2665] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:35.788669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:35.790149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:35.802444 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2286df-d5d3-47dd-9a75-0aeb7edd24d8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:35.807882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:35.808782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:35.809072 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:35.809353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] PATH_INFO: `/v3/projects/58789fcd62714fcb85d8031f654e9840` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:35.810817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58789fcd62714fcb85d8031f654e9840)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:35.813623 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:35.867406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58789fcd62714fcb85d8031f654e9840', 'request_id': 'req-698ed7d8-be82-438e-8d4c-0b4b951f65d7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.877638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58789fcd62714fcb85d8031f654e9840', 'request_id': 'req-698ed7d8-be82-438e-8d4c-0b4b951f65d7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.883811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58789fcd62714fcb85d8031f654e9840', 'request_id': 'req-698ed7d8-be82-438e-8d4c-0b4b951f65d7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.894740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] The token cache is being invalidate because project 58789fcd62714fcb85d8031f654e9840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:35.895032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.895693 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:35.897213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1318/2666] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:35 2022] DELETE /identity/v3/projects/58789fcd62714fcb85d8031f654e9840 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:35.901272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:35.912220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13331-04fe-4410-ab85-7f41a23eebf8 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:35.971836 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:35.972723 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:35.973010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:35.973290 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] PATH_INFO: `/v3/users/11ead487020a43b8a76abd5d03022083` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:35.974679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ead487020a43b8a76abd5d03022083)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:35.976721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.025509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ead487020a43b8a76abd5d03022083'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.032451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ead487020a43b8a76abd5d03022083'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.033115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ead487020a43b8a76abd5d03022083'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.045144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ead487020a43b8a76abd5d03022083'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.045775 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-a4e7499e-592f-421e-a971-875fee8f7ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ead487020a43b8a76abd5d03022083'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.058874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1349/2667] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:35 2022] DELETE /identity/v3/users/11ead487020a43b8a76abd5d03022083 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:36.339924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.342157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:36.357575 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed7d8-be82-438e-8d4c-0b4b951f65d7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.433024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.434450 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.434751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.435092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] PATH_INFO: `/v3/projects/651fc21d70ad41f5a8a6884ae994300a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.436346 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=651fc21d70ad41f5a8a6884ae994300a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.438544 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.479522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:36.492739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '651fc21d70ad41f5a8a6884ae994300a', 'request_id': 'req-92075f92-ebba-42a6-af77-e3e2e67e7d2d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.506723 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '651fc21d70ad41f5a8a6884ae994300a', 'request_id': 'req-92075f92-ebba-42a6-af77-e3e2e67e7d2d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.517642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '651fc21d70ad41f5a8a6884ae994300a', 'request_id': 'req-92075f92-ebba-42a6-af77-e3e2e67e7d2d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.531983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] The token cache is being invalidate because project 651fc21d70ad41f5a8a6884ae994300a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:36.532411 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.533323 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-92075f92-ebba-42a6-af77-e3e2e67e7d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:36.535364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1319/2668] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:36 2022] DELETE /identity/v3/projects/651fc21d70ad41f5a8a6884ae994300a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:36.541037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.541702 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.542428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.562853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:36.564186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:36.576410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:36.627031 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1350/2669] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:36.634705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.635005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.635353 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.653658 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:36.654860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:36.663537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1320/2670] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:36.667844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.678069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbcd6f-2741-4272-b3c8-f683c61834aa None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.682747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.683454 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.683745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.684027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.684765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:36.685090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.686999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.698590 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1351/2671] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:36.703345 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.712709 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2395415-00c8-48cc-a7c3-036c49a8914c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.718458 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.719160 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.719449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.719731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.720474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.722381 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.746790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1321/2672] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:36 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:36.751020 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.761972 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15e3fc-5ea0-499d-b79e-4ac9a11afaac admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.820346 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.821011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.821295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.821571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.822276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.824195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.845061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1352/2673] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:36 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:36.849301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.859558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713f661-fdb5-4445-90bb-30b795f9a39f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.864183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.864834 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.865124 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.865404 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.866133 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.867769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.879007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1322/2674] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:36.882784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.893429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76d0e7-43d0-485a-b156-2cf99426c99c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.898067 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718528-46ef-4fe5-a1e1-7682ae58dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.898729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718528-46ef-4fe5-a1e1-7682ae58dc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.899022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718528-46ef-4fe5-a1e1-7682ae58dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.899343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718528-46ef-4fe5-a1e1-7682ae58dc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.900155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718528-46ef-4fe5-a1e1-7682ae58dc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.901761 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718528-46ef-4fe5-a1e1-7682ae58dc56 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.912222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1353/2675] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:36.916096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:36.925926 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1dc18-dfd1-4a4d-9c26-dd0ffc9e0ee7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:36.931067 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:36.931964 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.932254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.932645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] PATH_INFO: `/v3/projects/13088f1cc5f04882a3e7ab24c53a9017/users/547f2d0f0b9b4636b7e76b87df4c0479/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:36.947465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13088f1cc5f04882a3e7ab24c53a9017, user_id=547f2d0f0b9b4636b7e76b87df4c0479, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:36.950117 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:36.964063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1323/2676] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:36 2022] PUT /identity/v3/projects/13088f1cc5f04882a3e7ab24c53a9017/users/547f2d0f0b9b4636b7e76b87df4c0479/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:36.974718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:36.975188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:36.975319 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.011317 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] MFA Rules not processed for user `547f2d0f0b9b4636b7e76b87df4c0479`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:37.012517 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:37.081316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1354/2677] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:37.085777 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.153885 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87526a-53e0-4d77-b4ee-be711e864d1e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.159193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.159856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.160144 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.160422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.161113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.163011 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.191557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1324/2678] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:37 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:37.195637 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.206795 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c50ef-1793-4e5f-b0b0-8ae23a8422f6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.215465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:37.267340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.268016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.268303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.268586 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.269284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.271235 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.291489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1355/2679] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:37 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:37.295922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.306565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9dadf-9934-4165-bb8a-3e695e6b7a87 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.312541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.313194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.313484 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.313768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.314485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.316112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.326526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1325/2680] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:37.331618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.343822 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c464-866f-4622-84d4-199a5fca4485 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.348845 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.349982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.350271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.350551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] PATH_INFO: `/v3/projects/9b9e7e57f78045cdad45c90442d7695d/users/2331bb9010ed404982e523c0f810b734/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.365990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9e7e57f78045cdad45c90442d7695d, user_id=2331bb9010ed404982e523c0f810b734, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.368900 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.381948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1356/2681] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:37 2022] PUT /identity/v3/projects/9b9e7e57f78045cdad45c90442d7695d/users/2331bb9010ed404982e523c0f810b734/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:37.386647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.396871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268600f-f64d-4b50-9563-ca17b3717bb3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.429417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:37.455740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a5294-5914-45e1-8799-3ee88e1b970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.456407 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5294-5914-45e1-8799-3ee88e1b970e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.456694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5294-5914-45e1-8799-3ee88e1b970e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.456974 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a5294-5914-45e1-8799-3ee88e1b970e admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.457695 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a5294-5914-45e1-8799-3ee88e1b970e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.459320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a5294-5914-45e1-8799-3ee88e1b970e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.469574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1326/2682] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:37.473542 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.484151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3364d-e157-452a-86cb-550444bbc9af admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.490097 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.491129 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.491484 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.491830 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] PATH_INFO: `/v3/projects/9b9e7e57f78045cdad45c90442d7695d/users/2331bb9010ed404982e523c0f810b734/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.493944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9e7e57f78045cdad45c90442d7695d, user_id=2331bb9010ed404982e523c0f810b734, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.496677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.506912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1357/2683] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:37 2022] PUT /identity/v3/projects/9b9e7e57f78045cdad45c90442d7695d/users/2331bb9010ed404982e523c0f810b734/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:37.518322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.518617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.518902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.546354 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] MFA Rules not processed for user `2331bb9010ed404982e523c0f810b734`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:37.547616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:37.625577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1327/2684] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:37 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:37.640851 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.643016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:37.708217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d34e4c-e00f-4351-85a5-1f00f2d5e1d5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.711839 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.712486 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.712771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.713049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.722616 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.724077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.733597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1358/2685] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:37.815304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:37.824933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783deae-1fc3-42bb-ad5c-76374984ae59 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:37.829159 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:37.829793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:37.830074 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:37.830356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:37.893112 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:37.894758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:37.903683 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1328/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:38.290636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:38.292042 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:38.349543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3bdd2-c35c-4ba6-9f99-11a7fe8cf507 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:38.353320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:38.353971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:38.354262 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:38.354546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:38.356337 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:38.378633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:38.419572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:38.421437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c729e2-15d9-4ac0-ae74-0e25403d1977 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:38.430929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1359/2687] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:38.705751 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:38.707250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:38.720915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b6e6c-dd80-4b21-bbc4-5ca1442b3c95 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:38.725364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:38.726236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:38.726523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:38.726806 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] PATH_INFO: `/v3/users/9170df0310144cd6945bab5ee3b01b03` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:38.728035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9170df0310144cd6945bab5ee3b01b03)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:38.729959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:38.776450 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9170df0310144cd6945bab5ee3b01b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:38.779138 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:38.785512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9170df0310144cd6945bab5ee3b01b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:38.800689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9170df0310144cd6945bab5ee3b01b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:38.801349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9170df0310144cd6945bab5ee3b01b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:38.809043 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9170df0310144cd6945bab5ee3b01b03'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:38.816116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1329/2688] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:38 2022] DELETE /identity/v3/users/9170df0310144cd6945bab5ee3b01b03 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:38.820745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:38.821125 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:38.821413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:38.838717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:38.840304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:38.906311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1360/2689] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:38.915673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:38.917091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:38.979254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09b6d2-6245-4a24-966e-95eca65f1ca6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:38.983459 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21841f-2cee-4e18-abb9-adb12d64cb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:38.984616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21841f-2cee-4e18-abb9-adb12d64cb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:38.984898 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21841f-2cee-4e18-abb9-adb12d64cb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:38.985186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21841f-2cee-4e18-abb9-adb12d64cb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:38.994838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21841f-2cee-4e18-abb9-adb12d64cb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:38.996331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21841f-2cee-4e18-abb9-adb12d64cb3f service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.006446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1330/2690] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:39.323336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.325066 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:39.346243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811f901-a294-4987-beef-8aa467f59cf7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.362703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.364145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.364374 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.364652 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] PATH_INFO: `/v3/projects/2d36ce56fac64a56b1f0d9d3f30ca10f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.367760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d36ce56fac64a56b1f0d9d3f30ca10f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.370717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.435651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d36ce56fac64a56b1f0d9d3f30ca10f', 'request_id': 'req-4b642fc1-454b-43b7-99a9-8e8d18e324db'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:39.445687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d36ce56fac64a56b1f0d9d3f30ca10f', 'request_id': 'req-4b642fc1-454b-43b7-99a9-8e8d18e324db'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:39.453535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d36ce56fac64a56b1f0d9d3f30ca10f', 'request_id': 'req-4b642fc1-454b-43b7-99a9-8e8d18e324db'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:39.467225 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] The token cache is being invalidate because project 2d36ce56fac64a56b1f0d9d3f30ca10f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:39.467625 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:39.469007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-4b642fc1-454b-43b7-99a9-8e8d18e324db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:39.470740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1361/2691] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:39 2022] DELETE /identity/v3/projects/2d36ce56fac64a56b1f0d9d3f30ca10f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:39.475983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.477685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.478161 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.525194 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:39.526457 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:39.605798 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1331/2692] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:39.614666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.614962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.615264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.635869 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:39.637075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:39.645426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1362/2693] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:39.650098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.661512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ae575-e872-4300-a52d-4d97659968c9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.666867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.667560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.667850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.668131 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.668859 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:39.669170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.670788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.686263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1332/2694] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:39.687694 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.697629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef5f3e-b307-40aa-b213-2e23778d45f5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.702937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.703634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.703944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.704227 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.704923 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.706902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.735339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1363/2695] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:39 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:39.739366 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.749726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b2bd2-25a1-4350-a56b-589d2166adf4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.802740 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:39.810772 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.811178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.811794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.812699 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.813413 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.815401 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.838269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1333/2696] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:39 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:39.840015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.856766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15917909-6b84-4ec6-8b66-7b82680c07bc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.862299 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.862978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.863451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.863756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.865221 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.866113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.882534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1364/2697] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:39.883888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.894691 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effdc9b-8367-4918-a65c-e5a56935082e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.899830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1ea5e-079c-4791-95eb-f3d327bb7508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.900501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ea5e-079c-4791-95eb-f3d327bb7508 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.902084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ea5e-079c-4791-95eb-f3d327bb7508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.902084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1ea5e-079c-4791-95eb-f3d327bb7508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.902084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ea5e-079c-4791-95eb-f3d327bb7508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.903640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1ea5e-079c-4791-95eb-f3d327bb7508 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.917845 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1334/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:39.919519 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:39.926474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:39.933448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c98dde-c281-462d-969c-e406a264dcea admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:39.941413 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:39.942719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.943826 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.944195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] PATH_INFO: `/v3/projects/471926d4c8aa4814a6e89523e2466d92/users/2b1fe9b9f4724a949c45c9014888bc28/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:39.960224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471926d4c8aa4814a6e89523e2466d92, user_id=2b1fe9b9f4724a949c45c9014888bc28, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:39.963010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:39.979710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1365/2699] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:39 2022] PUT /identity/v3/projects/471926d4c8aa4814a6e89523e2466d92/users/2b1fe9b9f4724a949c45c9014888bc28/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:39.985241 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:39.985631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:39.986957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:40.006055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:40.007434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:40.078265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1335/2700] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:40.087709 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:40.089445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:40.161904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf04b-886b-40b9-98f9-507996794fd6 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:40.165976 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:40.167842 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:40.168139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:40.168429 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:40.180929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:40.182474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:40.194296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1366/2701] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:41.844674 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:41.848710 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:41.862678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca632e3-d10d-4815-963c-d22e5493aa3f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:41.873031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:41.875140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:41.875606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:41.876049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] PATH_INFO: `/v3/users/2ab3cbf49f514ba0bc7cf2e387f4933f` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:41.878274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab3cbf49f514ba0bc7cf2e387f4933f)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:41.881649 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:41.965338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab3cbf49f514ba0bc7cf2e387f4933f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:41.973821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab3cbf49f514ba0bc7cf2e387f4933f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:41.995671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab3cbf49f514ba0bc7cf2e387f4933f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:41.996428 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab3cbf49f514ba0bc7cf2e387f4933f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.008917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-eca2428a-f7f1-4d80-8703-e8b1116883f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab3cbf49f514ba0bc7cf2e387f4933f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.020836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1336/2702] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:41 2022] DELETE /identity/v3/users/2ab3cbf49f514ba0bc7cf2e387f4933f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:42.227754 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.246098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b014-8e07-4686-9706-0ef2d4ca6845 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.337294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.339684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.339985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.340274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] PATH_INFO: `/v3/projects/b98b8f9187ff4bcc9cc0f8b69fc0615a` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.341609 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b98b8f9187ff4bcc9cc0f8b69fc0615a)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:42.344131 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:42.425750 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98b8f9187ff4bcc9cc0f8b69fc0615a', 'request_id': 'req-6f0736de-8404-4ad5-9790-20ca77b97e47'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.439448 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98b8f9187ff4bcc9cc0f8b69fc0615a', 'request_id': 'req-6f0736de-8404-4ad5-9790-20ca77b97e47'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.446876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98b8f9187ff4bcc9cc0f8b69fc0615a', 'request_id': 'req-6f0736de-8404-4ad5-9790-20ca77b97e47'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.460057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] The token cache is being invalidate because project b98b8f9187ff4bcc9cc0f8b69fc0615a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:42.460506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.461294 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-6f0736de-8404-4ad5-9790-20ca77b97e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:42.466260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1367/2703] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:42 2022] DELETE /identity/v3/projects/b98b8f9187ff4bcc9cc0f8b69fc0615a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:42.468832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.470039 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.470390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.490426 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:42.491755 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:42.541556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:42.569816 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1337/2704] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:42.571570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.571873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.572161 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.609437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:42.611626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:42.621162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1368/2705] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:42.626942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.637607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b30a-a194-4a8f-b112-145f8f7e2505 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.648312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.649056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.649256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.649534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.650263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:42.650614 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:42.653078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:42.672514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1338/2706] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:42.676525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.685833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:42.691421 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d81a44-1b76-44d7-95cd-f986fd6a43a5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.698122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.698899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.699243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.699526 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.701013 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:42.703667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:42.739697 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1369/2707] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:42 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:42.743824 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.756348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca19a11-f1a1-423b-a7e3-a6c33fcd43b6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.834577 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.835415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.835796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.836174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.837115 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:42.839543 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:42.862768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1339/2708] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:42 2022] POST /identity/v3/users => generated 282 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:42.866916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.879706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e969e4b-51f7-49c7-bbc2-13ebfc789f2b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.885828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.886508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.887458 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.887745 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.889046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:42.891475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:42.904451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1370/2709] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:42.908757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.920318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba632eb-91af-4990-b4c4-6f4adafd47b9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.925537 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04087ad-83f8-48cc-bc5c-a51a48174b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.926265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04087ad-83f8-48cc-bc5c-a51a48174b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.926567 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04087ad-83f8-48cc-bc5c-a51a48174b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.926843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04087ad-83f8-48cc-bc5c-a51a48174b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:42.927840 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04087ad-83f8-48cc-bc5c-a51a48174b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:42.929620 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04087ad-83f8-48cc-bc5c-a51a48174b28 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:42.942230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1340/2710] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:42.946215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:42.958224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ad301-525f-4036-b269-d078a2eeba72 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:42.976231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:42.977623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:42.978490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:42.979442 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] PATH_INFO: `/v3/projects/221db8ebac3e440f923ad07690088ff4/users/2b13ecc093094923a8b07dc9fe8a0cb8/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.025859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=221db8ebac3e440f923ad07690088ff4, user_id=2b13ecc093094923a8b07dc9fe8a0cb8, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.031536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.057808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1371/2711] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:42 2022] PUT /identity/v3/projects/221db8ebac3e440f923ad07690088ff4/users/2b13ecc093094923a8b07dc9fe8a0cb8/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:43.067966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.068262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.068565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.100275 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] MFA Rules not processed for user `2b13ecc093094923a8b07dc9fe8a0cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:43.101485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:43.195613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.197916 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:43.204025 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1341/2712] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:43.207850 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.274336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:43.278634 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf4a6d-2075-4187-b178-408fd7094aed admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.284788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.285703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.286581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.286886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] PATH_INFO: `/v3/users/547f2d0f0b9b4636b7e76b87df4c0479` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.288217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547f2d0f0b9b4636b7e76b87df4c0479)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.290163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.317471 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cf39f-a310-45b1-bbf8-7bda20862451 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.324515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.325902 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.326500 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.327146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.328669 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.331664 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.363584 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547f2d0f0b9b4636b7e76b87df4c0479'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:43.375278 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1342/2713] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:43 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:43.378922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.380668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547f2d0f0b9b4636b7e76b87df4c0479'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:43.382473 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547f2d0f0b9b4636b7e76b87df4c0479'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:43.402057 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547f2d0f0b9b4636b7e76b87df4c0479'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:43.403332 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5c58a883-5bec-40d7-a603-532562623189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547f2d0f0b9b4636b7e76b87df4c0479'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:43.429113 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1372/2714] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:43 2022] DELETE /identity/v3/users/547f2d0f0b9b4636b7e76b87df4c0479 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:43.436318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.437508 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.439238 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.471381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:43.472988 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:43.495578 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbde19-d3f1-46ac-b799-37a2f8a71a2f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.497122 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:43.586596 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1373/2715] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:43.595817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.596655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.596952 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.597238 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.597947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.598344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.599968 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.600985 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:43.630726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1343/2716] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:43 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:43.636055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.639936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:43.663415 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802235b1-f7f3-4324-a3cd-89bd95c986f0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.668617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.669470 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.669940 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.670360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.671937 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.673698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.691599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1344/2717] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:43.693818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.722338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9d0fe-6b5b-4733-8c9e-8d7a974f7f4f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.731808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543633dc-42ca-4022-99cd-915666e7c3d4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.732268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.733172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.734159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.734982 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.745626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.747417 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.748199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.749876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.750338 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:43.750917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] PATH_INFO: `/v3/projects/4cbc8519336245b883bdf16305581d12/users/6ad4eeac6f02402b94224ca58e054de5/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:43.772466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1374/2718] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:43.799014 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbc8519336245b883bdf16305581d12, user_id=6ad4eeac6f02402b94224ca58e054de5, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:43.809013 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:43.841731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1345/2719] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:43 2022] PUT /identity/v3/projects/4cbc8519336245b883bdf16305581d12/users/6ad4eeac6f02402b94224ca58e054de5/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:43.846229 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:43.871074 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed687-2e61-42e0-8478-d288613c2145 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:43.997126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b87a7c-81dd-4b2b-b6fa-ce7126d2d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:43.998053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b87a7c-81dd-4b2b-b6fa-ce7126d2d609 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:43.998488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b87a7c-81dd-4b2b-b6fa-ce7126d2d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:44.009302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b87a7c-81dd-4b2b-b6fa-ce7126d2d609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:44.011397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b87a7c-81dd-4b2b-b6fa-ce7126d2d609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:44.021904 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b87a7c-81dd-4b2b-b6fa-ce7126d2d609 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:44.044138 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1375/2720] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:44.048474 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:44.061903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e266b1-1d1a-4dac-8a8e-82ba3af68d1f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:44.080462 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:44.081270 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:44.081572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:44.081895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] PATH_INFO: `/v3/projects/4cbc8519336245b883bdf16305581d12/users/6ad4eeac6f02402b94224ca58e054de5/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:44.088071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbc8519336245b883bdf16305581d12, user_id=6ad4eeac6f02402b94224ca58e054de5, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:44.090796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:44.126754 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1346/2721] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:44 2022] PUT /identity/v3/projects/4cbc8519336245b883bdf16305581d12/users/6ad4eeac6f02402b94224ca58e054de5/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:44.127756 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:44.128056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:44.128341 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:44.185779 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] MFA Rules not processed for user `6ad4eeac6f02402b94224ca58e054de5`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:44.191670 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:44.320078 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:44.332376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:44.335008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:44.379155 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1376/2722] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:44.386393 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:44.392608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:44.398435 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:44.452817 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad0cd-3b1d-4fca-859c-0afd21776b25 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:44.459448 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:44.461149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:44.461737 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:44.462595 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] PATH_INFO: `/v3/projects/13088f1cc5f04882a3e7ab24c53a9017` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:44.464881 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=13088f1cc5f04882a3e7ab24c53a9017)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:44.467321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:44.517209 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7991942-518e-4db6-b5b4-a699b9762949 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:44.550370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13088f1cc5f04882a3e7ab24c53a9017', 'request_id': 'req-192b9104-1acc-431b-9e01-09f9f2b4be9b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.563245 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13088f1cc5f04882a3e7ab24c53a9017', 'request_id': 'req-192b9104-1acc-431b-9e01-09f9f2b4be9b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.574493 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13088f1cc5f04882a3e7ab24c53a9017', 'request_id': 'req-192b9104-1acc-431b-9e01-09f9f2b4be9b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.589945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] The token cache is being invalidate because project 13088f1cc5f04882a3e7ab24c53a9017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:44.590276 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.590921 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.596730 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1347/2723] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:44 2022] DELETE /identity/v3/projects/13088f1cc5f04882a3e7ab24c53a9017 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:44.598151 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:44.604424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:44.609427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:44.610258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:44.610656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:44.611056 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:44.613079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:44.705535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:44.710272 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:44.726527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b9104-1acc-431b-9e01-09f9f2b4be9b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:44.734591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1377/2724] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:44.736943 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:44.737692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:44.737978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:44.738259 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] PATH_INFO: `/v3/users/2331bb9010ed404982e523c0f810b734` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:44.740301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2331bb9010ed404982e523c0f810b734)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:44.742240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:44.837352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2331bb9010ed404982e523c0f810b734'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.848625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:44.862297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2331bb9010ed404982e523c0f810b734'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.893520 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2331bb9010ed404982e523c0f810b734'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.894251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2331bb9010ed404982e523c0f810b734'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.912635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2331bb9010ed404982e523c0f810b734'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:44.943408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1348/2725] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:44 2022] DELETE /identity/v3/users/2331bb9010ed404982e523c0f810b734 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:45.338292 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:45.339920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.354862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0ef04-3303-467b-8992-75b8efee6db9 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:45.421728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:45.442647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:45.443886 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.444182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.444537 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] PATH_INFO: `/v3/users/2b13ecc093094923a8b07dc9fe8a0cb8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.445847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b13ecc093094923a8b07dc9fe8a0cb8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:45.447853 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:45.520912 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b13ecc093094923a8b07dc9fe8a0cb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.533061 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b13ecc093094923a8b07dc9fe8a0cb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.534639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b13ecc093094923a8b07dc9fe8a0cb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.565747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b13ecc093094923a8b07dc9fe8a0cb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.566788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-729e7d1d-45b9-4f16-bf6e-382c0e4f6c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b13ecc093094923a8b07dc9fe8a0cb8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.588453 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1378/2726] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:45 2022] DELETE /identity/v3/users/2b13ecc093094923a8b07dc9fe8a0cb8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:45.591523 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:45.594388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.595362 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba898-0160-4803-a113-65951e56eda9 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.596102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba898-0160-4803-a113-65951e56eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.596581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba898-0160-4803-a113-65951e56eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.614667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74c8a-e362-4d59-a888-69e73563f3ea admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:45.618394 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-26bba898-0160-4803-a113-65951e56eda9 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:45.620727 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-26bba898-0160-4803-a113-65951e56eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.696925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:45.697717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.698008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.698332 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] PATH_INFO: `/v3/projects/9b9e7e57f78045cdad45c90442d7695d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.700211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9e7e57f78045cdad45c90442d7695d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:45.701820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:45.747412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1379/2727] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:45.762784 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba898-0160-4803-a113-65951e56eda9 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:45.765703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-26bba898-0160-4803-a113-65951e56eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.766705 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9e7e57f78045cdad45c90442d7695d', 'request_id': 'req-3909d78d-e6e6-4765-bde7-5ca90c6fae50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.782171 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9e7e57f78045cdad45c90442d7695d', 'request_id': 'req-3909d78d-e6e6-4765-bde7-5ca90c6fae50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.792152 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9e7e57f78045cdad45c90442d7695d', 'request_id': 'req-3909d78d-e6e6-4765-bde7-5ca90c6fae50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.804717 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] The token cache is being invalidate because project 9b9e7e57f78045cdad45c90442d7695d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:45.805008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.805666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3909d78d-e6e6-4765-bde7-5ca90c6fae50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:45.807607 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1349/2728] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:45 2022] DELETE /identity/v3/projects/9b9e7e57f78045cdad45c90442d7695d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:45.813408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af827-2fcd-41fc-ba1d-a67365cc8065 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.813731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af827-2fcd-41fc-ba1d-a67365cc8065 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.813958 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7af827-2fcd-41fc-ba1d-a67365cc8065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.837618 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aa7af827-2fcd-41fc-ba1d-a67365cc8065 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:45.838870 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aa7af827-2fcd-41fc-ba1d-a67365cc8065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.862414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba898-0160-4803-a113-65951e56eda9 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:45.900046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:45.905414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:45.919269 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1350/2729] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:45.921179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.921490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.921790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.927622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:45.928304 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.928598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.928880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.930746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.943965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:45.945406 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de71c48-41c4-41a2-9292-6fc208d97cac service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:45.953356 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] MFA Rules not processed for user `2b1fe9b9f4724a949c45c9014888bc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:45.954671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.955914 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1380/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:45.957149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:45.957443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:45.957726 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:45.976492 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:45.977854 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:45.988120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1381/2731] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:45.992472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.005794 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89631131-f578-4de0-b5cf-855d47c0ca01 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.012329 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.013156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.013546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.014034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.015360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:46.015771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.017543 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.035109 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1351/2732] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:46.036033 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.037556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.039219 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1382/2733] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:24:46.040107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.051561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814376f-f819-4bb5-a2c5-86c01dfdd3d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.053600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12579ac-303c-432e-9aec-afcf6645bcd8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.057164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.057986 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.058295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.058568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.059329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.060178 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.062303 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.063232 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.063796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.064770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.065670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.068925 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.094829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1383/2734] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:46 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:46.099349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.101001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1352/2735] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:46 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:46.104746 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.178276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b3e94-0335-460e-a486-31f904dca36c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.182801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6282d-2a1e-437e-864b-100b141b296e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.184603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.185389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.185685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.185970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.186977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.189053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.190409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.191308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.191663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.192016 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.192780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.194788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.212528 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1384/2736] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:46 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:46.216076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.219541 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1353/2737] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:46 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:46.223634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.232975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced3dc-76cd-4fbf-b929-ea2408090acb admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.236599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881134dc-a43c-4cfc-9c57-eac4648e6b0f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.239724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.240410 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.240703 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.241045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.241728 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.243212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.243496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.244021 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.244511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.244860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.245660 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.248041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.262583 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1385/2738] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:46.262788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1354/2739] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:46.263636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.265019 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.276172 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700493-047c-4ec6-9ab1-f514effe1596 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.279608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad4419-e8e0-4854-8efe-225dab97454e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.282399 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.283566 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.285068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.285616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] PATH_INFO: `/v3/projects/1486fd2699974dc5871ceb080c3c1c99/users/546d6193afe3452985de2a4d02170564/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.293506 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.294347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.294706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.295077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.296710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.298846 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.318580 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1386/2740] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:46.318785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1486fd2699974dc5871ceb080c3c1c99, user_id=546d6193afe3452985de2a4d02170564, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.318908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.319010 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.320487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.335801 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1355/2741] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:46 2022] PUT /identity/v3/projects/1486fd2699974dc5871ceb080c3c1c99/users/546d6193afe3452985de2a4d02170564/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:46.336053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd65b16-cb7b-4b5b-85e2-0225081c1001 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.337037 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.367228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:46.398451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.399488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.399777 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.400058 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] PATH_INFO: `/v3/projects/221db8ebac3e440f923ad07690088ff4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.401364 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221db8ebac3e440f923ad07690088ff4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.403342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.406343 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:46.411365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2f63-65a3-45e9-ba3a-795c1e93dca5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.416205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.417148 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.417379 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.417663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] PATH_INFO: `/v3/projects/59f849c8d7bc407f9a3cbe803152a042/users/de153e65fc4c4fb691f0f6313e26966f/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.434256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f849c8d7bc407f9a3cbe803152a042, user_id=de153e65fc4c4fb691f0f6313e26966f, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.437647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.450831 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1356/2742] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:46 2022] PUT /identity/v3/projects/59f849c8d7bc407f9a3cbe803152a042/users/de153e65fc4c4fb691f0f6313e26966f/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:46.451435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.465183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221db8ebac3e440f923ad07690088ff4', 'request_id': 'req-c51fa3d7-b139-45f7-8e33-d67ae1760255'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.473876 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221db8ebac3e440f923ad07690088ff4', 'request_id': 'req-c51fa3d7-b139-45f7-8e33-d67ae1760255'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.480705 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221db8ebac3e440f923ad07690088ff4', 'request_id': 'req-c51fa3d7-b139-45f7-8e33-d67ae1760255'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.497999 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] The token cache is being invalidate because project 221db8ebac3e440f923ad07690088ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:46.498333 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.499166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c51fa3d7-b139-45f7-8e33-d67ae1760255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.503707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1387/2743] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:46 2022] DELETE /identity/v3/projects/221db8ebac3e440f923ad07690088ff4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:46.503707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.503707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.503707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.525008 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5e273-ec89-47c1-a1c4-48ce71155d1e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.529860 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.531210 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.531791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.531933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.532590 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.534197 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.535735 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] MFA Rules not processed for user `de153e65fc4c4fb691f0f6313e26966f`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:46.537400 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.545398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1357/2744] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:46.546391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.549985 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.565592 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8386a5-7bfe-4791-a7dc-c542c236a674 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.571630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.572606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.573082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.573250 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] PATH_INFO: `/v3/users/6ad4eeac6f02402b94224ca58e054de5` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.574511 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad4eeac6f02402b94224ca58e054de5)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.576517 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.614534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1388/2745] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:46.615500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.622264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.634146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad4eeac6f02402b94224ca58e054de5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.636000 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb13e31-f3bb-4360-8c9c-fcf91006b280 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.643449 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad4eeac6f02402b94224ca58e054de5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.644018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.644995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.645674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.645979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] PATH_INFO: `/v3/projects/1486fd2699974dc5871ceb080c3c1c99/users/546d6193afe3452985de2a4d02170564/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.648475 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1486fd2699974dc5871ceb080c3c1c99, user_id=546d6193afe3452985de2a4d02170564, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.652686 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.665818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad4eeac6f02402b94224ca58e054de5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.667113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad4eeac6f02402b94224ca58e054de5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.673636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1389/2746] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:46 2022] PUT /identity/v3/projects/1486fd2699974dc5871ceb080c3c1c99/users/546d6193afe3452985de2a4d02170564/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:46.676314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad4eeac6f02402b94224ca58e054de5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:46.678232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:46.680032 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.692718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1358/2747] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:46 2022] DELETE /identity/v3/users/6ad4eeac6f02402b94224ca58e054de5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:46.754224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdaf65-a3f2-43c1-86a8-5883f607d290 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:46.798674 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:46.845090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:46.845760 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:46.846049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:46.846579 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:46.849128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:46.961205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:46.963766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c81319-b98f-43d6-a10e-4f7a71a38b56 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:46.977050 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1390/2748] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:47.262020 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:47.263793 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:47.311231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:47.402584 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950dce3-bb0b-4db6-a9fb-1abbaa90728a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:47.411113 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:47.411994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.412412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.412887 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] PATH_INFO: `/v3/projects/4cbc8519336245b883bdf16305581d12` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.414301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbc8519336245b883bdf16305581d12)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:47.416424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:47.497639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbc8519336245b883bdf16305581d12', 'request_id': 'req-37d64487-1050-46a2-8ba2-7cff1940b6ac'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:47.511871 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbc8519336245b883bdf16305581d12', 'request_id': 'req-37d64487-1050-46a2-8ba2-7cff1940b6ac'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:47.521794 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbc8519336245b883bdf16305581d12', 'request_id': 'req-37d64487-1050-46a2-8ba2-7cff1940b6ac'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:47.536959 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] The token cache is being invalidate because project 4cbc8519336245b883bdf16305581d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:47.537280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:47.538049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-37d64487-1050-46a2-8ba2-7cff1940b6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:47.540143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1359/2749] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:47 2022] DELETE /identity/v3/projects/4cbc8519336245b883bdf16305581d12 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:47.547645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.548160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.548248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.571018 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:47.572829 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:47.663179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1391/2750] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:47.669815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.670314 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.670442 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.691895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:47.693046 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:47.701382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1360/2751] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:47.706391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:47.718049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5e278-d8bc-4f44-9412-6260f62e3aa5 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:47.723165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:47.723844 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.724132 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.725252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.725252 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:47.725578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:47.727239 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:47.739667 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1392/2752] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:47.744116 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:47.755246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed3174-9680-4cf5-83cb-cbd61dc055c0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:47.760218 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:47.761078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.761368 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.761651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.762351 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:47.764305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:47.809504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1361/2753] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:47 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:47.813874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:47.824762 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9b4d-4907-4214-a58a-a5c93079740d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:47.897629 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:47.898748 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.899146 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.900048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.900298 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:47.902380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:47.915958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:47.931105 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1393/2754] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:47 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:47.934882 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:47.946766 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e6abc-7242-44a0-b715-4196fb9c9380 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:47.953843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:47.954600 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:47.955561 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:47.963280 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:47.965522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:47.968258 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:47.981392 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1362/2755] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:47.985834 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:47.996786 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978b4a6-9431-4a50-bf75-8739ec6db71c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.006156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbfd989-0ab4-4aba-9027-2adb40d1d624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.006864 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfd989-0ab4-4aba-9027-2adb40d1d624 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.007669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfd989-0ab4-4aba-9027-2adb40d1d624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.007669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbfd989-0ab4-4aba-9027-2adb40d1d624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.008463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfd989-0ab4-4aba-9027-2adb40d1d624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.015028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbfd989-0ab4-4aba-9027-2adb40d1d624 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.029527 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1394/2756] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:48.032022 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.045195 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c17f8-becf-41bb-839b-81093dd424cf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.052036 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.052946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.053331 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.053539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] PATH_INFO: `/v3/projects/12261f8e421e4ea583c68f861f6f845e/users/8d8d7813fd9343ab80e0ad8ff1e093e4/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.071001 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12261f8e421e4ea583c68f861f6f845e, user_id=8d8d7813fd9343ab80e0ad8ff1e093e4, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.073837 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.100071 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1363/2757] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:48 2022] PUT /identity/v3/projects/12261f8e421e4ea583c68f861f6f845e/users/8d8d7813fd9343ab80e0ad8ff1e093e4/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:48.113843 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.114137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.114420 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.149062 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] MFA Rules not processed for user `8d8d7813fd9343ab80e0ad8ff1e093e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:48.150588 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:48.260875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1395/2758] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:48.265867 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.328947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:48.367939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532adff5-d2b7-4722-9471-ec10694a0e25 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.373622 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.374522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.374814 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.375129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.376110 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.378546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.410518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1364/2759] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:48 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:48.414378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.426809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d9d7f-305a-4626-bc0b-a6ee088b0a83 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.507128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.507907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.509512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.509878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.510681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.512749 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.562699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1396/2760] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:48 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:48.565673 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.579432 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816c26d-7513-4635-8db9-84f55a7e01d9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.584228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.584922 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.585220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.585499 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.586233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.587858 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.609832 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1365/2761] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:48.613641 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.629459 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80fb56-fb59-4808-85fc-518c17fbcc73 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.639300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.640929 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.641318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.641489 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] PATH_INFO: `/v3/projects/c4ecf674bb624c06b1e6ef90afa9375d/users/bc9aa51e4ca34407b24962f48fe323c4/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.686984 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ecf674bb624c06b1e6ef90afa9375d, user_id=bc9aa51e4ca34407b24962f48fe323c4, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.690003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.742038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1397/2762] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:48 2022] PUT /identity/v3/projects/c4ecf674bb624c06b1e6ef90afa9375d/users/bc9aa51e4ca34407b24962f48fe323c4/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:48.751574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.762666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d3f9-7885-4ba5-a488-33376aa99b08 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.877227 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d4132-6963-4655-bf19-99df27df5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.878048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d4132-6963-4655-bf19-99df27df5db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.878339 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d4132-6963-4655-bf19-99df27df5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.878617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d4132-6963-4655-bf19-99df27df5db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.879408 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d4132-6963-4655-bf19-99df27df5db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.881263 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d4132-6963-4655-bf19-99df27df5db1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.894518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1366/2763] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:48.899076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:48.922619 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202585-d1ad-4648-800b-565b50f06bed admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:48.935156 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:48.936729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.937179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.937540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] PATH_INFO: `/v3/projects/c4ecf674bb624c06b1e6ef90afa9375d/users/bc9aa51e4ca34407b24962f48fe323c4/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:48.940901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ecf674bb624c06b1e6ef90afa9375d, user_id=bc9aa51e4ca34407b24962f48fe323c4, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:48.944306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:48.962507 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1398/2764] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:48 2022] PUT /identity/v3/projects/c4ecf674bb624c06b1e6ef90afa9375d/users/bc9aa51e4ca34407b24962f48fe323c4/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:48.975781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:48.976120 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:48.976842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:49.018335 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] MFA Rules not processed for user `bc9aa51e4ca34407b24962f48fe323c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:49.019675 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:49.101027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1367/2765] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:49.111801 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:49.113685 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:49.154585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:49.192049 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46859a2d-7d9b-43b3-a0fa-24ffc0aff050 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:49.196633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:49.197714 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:49.198168 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:49.198535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:49.211733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:49.213279 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:49.224463 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1399/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:49.279504 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:49.281178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:49.294890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093dc8d-5869-4d45-a708-6837544a524f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:49.300079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d2c9f-d8d6-47d5-8698-b254d0ffb5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:49.300966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d2c9f-d8d6-47d5-8698-b254d0ffb5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:49.301322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d2c9f-d8d6-47d5-8698-b254d0ffb5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:49.301668 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d2c9f-d8d6-47d5-8698-b254d0ffb5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:49.341084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:49.387344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d2c9f-d8d6-47d5-8698-b254d0ffb5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:49.389063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d2c9f-d8d6-47d5-8698-b254d0ffb5c9 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:49.411327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1368/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:49.878153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:49.880518 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:49.985991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe67c2-15ff-4c1f-b6fa-2b3c72b9a05c service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:50.004893 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:50.006111 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:50.006525 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:50.006917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] PATH_INFO: `/v3/users/de153e65fc4c4fb691f0f6313e26966f` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:50.008515 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de153e65fc4c4fb691f0f6313e26966f)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:50.011090 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:50.082002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de153e65fc4c4fb691f0f6313e26966f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:50.095850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de153e65fc4c4fb691f0f6313e26966f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:50.096770 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de153e65fc4c4fb691f0f6313e26966f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:50.116019 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de153e65fc4c4fb691f0f6313e26966f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:50.117034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de153e65fc4c4fb691f0f6313e26966f'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:50.134251 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1400/2768] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:49 2022] DELETE /identity/v3/users/de153e65fc4c4fb691f0f6313e26966f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:50.139265 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:50.140729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:50.141251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:50.171254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:50.172932 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:50.266163 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1369/2769] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:50.272559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:50.274192 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:50.403940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:50.416188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abcc57-8bab-43b2-afc0-17b8e7adb64c admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:50.428128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f03753-03ee-4f90-8a74-283c1b8aeee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:50.428820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f03753-03ee-4f90-8a74-283c1b8aeee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:50.429106 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f03753-03ee-4f90-8a74-283c1b8aeee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:50.429391 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f03753-03ee-4f90-8a74-283c1b8aeee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:50.444504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f03753-03ee-4f90-8a74-283c1b8aeee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:50.446040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f03753-03ee-4f90-8a74-283c1b8aeee0 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:50.464276 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1401/2770] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:51.069984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:51.071781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:51.092082 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3373953-efb4-415c-8f4b-6e912fc6e070 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:51.110966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:51.114162 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:51.114376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:51.115440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] PATH_INFO: `/v3/projects/59f849c8d7bc407f9a3cbe803152a042` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:51.120007 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f849c8d7bc407f9a3cbe803152a042)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:51.122224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:51.250349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f849c8d7bc407f9a3cbe803152a042', 'request_id': 'req-d9b1b262-6f42-4262-98d1-950c9b89ccb6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:51.272573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f849c8d7bc407f9a3cbe803152a042', 'request_id': 'req-d9b1b262-6f42-4262-98d1-950c9b89ccb6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:51.280978 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f849c8d7bc407f9a3cbe803152a042', 'request_id': 'req-d9b1b262-6f42-4262-98d1-950c9b89ccb6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:51.305421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] The token cache is being invalidate because project 59f849c8d7bc407f9a3cbe803152a042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:51.305773 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:51.307796 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d9b1b262-6f42-4262-98d1-950c9b89ccb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:51.317886 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1370/2771] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:51 2022] DELETE /identity/v3/projects/59f849c8d7bc407f9a3cbe803152a042 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:51.319695 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:51.320140 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:51.320320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:51.360505 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:51.361633 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:51.547073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1402/2772] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:51.623433 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:51.624213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:51.624700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:51.649522 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:51.651842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:51.701718 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:51.703209 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1371/2773] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:51.722715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742e51-4540-4d9f-8907-ad65168a4b1b None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:51.739741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:51.740571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:51.740883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:51.741137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:51.741874 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:51.742193 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:51.749708 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:51.784424 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1403/2774] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:51.788833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:51.808505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723d923-8d99-4cc6-ba34-dbef5e45c7de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:51.821689 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:51.822364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:51.822663 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:51.825108 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:51.825929 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:51.830382 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:51.895906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1372/2775] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:51 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:51.898160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:51.913411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cc31d-ed60-479a-98ee-3a2082ed0a00 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:52.041724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:52.042668 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.043144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.043582 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.044289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:52.046860 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:52.108939 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:52.122496 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1404/2776] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:51 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:52.141770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75dedb-0957-4083-9d3f-88fe2e041fd1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:52.147032 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbb895-2d02-4729-9245-6015f4793b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:52.147745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbb895-2d02-4729-9245-6015f4793b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.148041 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbb895-2d02-4729-9245-6015f4793b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.148324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbb895-2d02-4729-9245-6015f4793b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.149225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbb895-2d02-4729-9245-6015f4793b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:52.150856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbb895-2d02-4729-9245-6015f4793b19 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:52.187091 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1373/2777] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:52.190884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:52.205081 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a8d5-b8f1-4b55-aef8-fd703941a045 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:52.211428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:52.212124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.212414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.212850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.213778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:52.215567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:52.233560 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.233872 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.234164 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.242440 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1405/2778] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:52.243504 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:52.256328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be075755-26d7-4857-8460-2bb2b5bbb4d1 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:52.265535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e78de-1ca4-4f54-9823-07f2393aa26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:52.265535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e78de-1ca4-4f54-9823-07f2393aa26e admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.265535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e78de-1ca4-4f54-9823-07f2393aa26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.265535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e78de-1ca4-4f54-9823-07f2393aa26e admin admin] PATH_INFO: `/v3/projects/9b28897ace8744e985a1ca8d3f4327ff/users/a2a550006e5c41fd97fb015f068b346b/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.277556 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] MFA Rules not processed for user `546d6193afe3452985de2a4d02170564`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:52.279123 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:52.282954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e78de-1ca4-4f54-9823-07f2393aa26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b28897ace8744e985a1ca8d3f4327ff, user_id=a2a550006e5c41fd97fb015f068b346b, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:52.283913 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:52.286163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e78de-1ca4-4f54-9823-07f2393aa26e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:52.306813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1406/2779] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:52 2022] PUT /identity/v3/projects/9b28897ace8744e985a1ca8d3f4327ff/users/a2a550006e5c41fd97fb015f068b346b/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:52.317365 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.317655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.317935 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.348082 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] MFA Rules not processed for user `a2a550006e5c41fd97fb015f068b346b`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:52.349195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:52.376828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1374/2780] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:52.377048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:52.387851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:52.390440 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:52.435510 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1407/2781] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:52.448311 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:52.450203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:52.479390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29352ab8-89d1-45f4-9af6-22461a469293 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:52.514858 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f14c-0b6c-4f0e-a85c-f79dec976513 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:52.519889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:52.520710 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.521108 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.521620 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.534034 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:52.536243 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:52.547182 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1408/2782] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:52.548228 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:52.548894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:52.549186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:52.549465 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:52.551322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:52.587938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:52.619414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:52.621224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316417f-84f3-4391-88e6-41f4c899141a service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:52.632839 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1375/2783] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:53.556153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:53.558675 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:53.636120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01d44-bff6-41f5-a16a-8a2b620c96d8 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:53.640711 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:53.641594 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:53.641880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:53.642195 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] PATH_INFO: `/v3/users/8d8d7813fd9343ab80e0ad8ff1e093e4` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:53.643414 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8d7813fd9343ab80e0ad8ff1e093e4)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:53.645336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:53.701603 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8d7813fd9343ab80e0ad8ff1e093e4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:53.711622 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8d7813fd9343ab80e0ad8ff1e093e4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:53.712356 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8d7813fd9343ab80e0ad8ff1e093e4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:53.724521 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:53.727010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8d7813fd9343ab80e0ad8ff1e093e4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:53.727778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7789405b-d700-4879-9643-dfe563c4d5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8d7813fd9343ab80e0ad8ff1e093e4'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:53.743940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1409/2784] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:53 2022] DELETE /identity/v3/users/8d8d7813fd9343ab80e0ad8ff1e093e4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:53.748365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:53.748897 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:53.749102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:53.771782 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:53.773165 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:53.845693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:53.846079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:53.846367 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:53.867857 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1376/2785] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:53.874426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] MFA Rules not processed for user `2b1fe9b9f4724a949c45c9014888bc28`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:53.875778 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:53.877294 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:53.878835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:53.940425 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1410/2786] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:53.949208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4760a89-cd34-4a07-b0f6-55b8a67fc6de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:53.955436 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:53.956101 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:53.956422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:53.956731 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:53.969697 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:53.972619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:53.984594 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1377/2787] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:24:54.333482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:54.335533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:54.350823 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952b92c-fd3a-4675-a329-c850a77ccd38 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:54.356028 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:54.357147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:54.357628 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:54.357907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] PATH_INFO: `/v3/projects/12261f8e421e4ea583c68f861f6f845e` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:54.359220 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12261f8e421e4ea583c68f861f6f845e)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:54.361284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:54.421546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12261f8e421e4ea583c68f861f6f845e', 'request_id': 'req-40c438bc-b062-4a38-b480-2c5afcb7b30a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.434614 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12261f8e421e4ea583c68f861f6f845e', 'request_id': 'req-40c438bc-b062-4a38-b480-2c5afcb7b30a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.446717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12261f8e421e4ea583c68f861f6f845e', 'request_id': 'req-40c438bc-b062-4a38-b480-2c5afcb7b30a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.472350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] The token cache is being invalidate because project 12261f8e421e4ea583c68f861f6f845e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:54.472825 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.473655 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.475547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1411/2788] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:54 2022] DELETE /identity/v3/projects/12261f8e421e4ea583c68f861f6f845e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:54.479495 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:54.496386 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de6cd1-14da-4510-aa3a-b9d63927c4b7 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:54.595969 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:54.597312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:54.597696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:54.598189 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] PATH_INFO: `/v3/users/bc9aa51e4ca34407b24962f48fe323c4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:54.599678 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9aa51e4ca34407b24962f48fe323c4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:54.602342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:54.637055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:54.677757 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9aa51e4ca34407b24962f48fe323c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.689899 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9aa51e4ca34407b24962f48fe323c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.730055 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9aa51e4ca34407b24962f48fe323c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.731310 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9aa51e4ca34407b24962f48fe323c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.739812 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3a392b3b-6d99-4061-bb50-fc6902048d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9aa51e4ca34407b24962f48fe323c4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:54.746402 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1378/2789] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:54 2022] DELETE /identity/v3/users/bc9aa51e4ca34407b24962f48fe323c4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:55.074949 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.076535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:55.090766 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c438bc-b062-4a38-b480-2c5afcb7b30a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.163476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.164287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.164755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.165037 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] PATH_INFO: `/v3/projects/c4ecf674bb624c06b1e6ef90afa9375d` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.166687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ecf674bb624c06b1e6ef90afa9375d)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.169053 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.190647 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:55.261217 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ecf674bb624c06b1e6ef90afa9375d', 'request_id': 'req-e95ef559-0929-4752-a5d2-ab22819c19e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:55.269213 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ecf674bb624c06b1e6ef90afa9375d', 'request_id': 'req-e95ef559-0929-4752-a5d2-ab22819c19e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:55.276073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ecf674bb624c06b1e6ef90afa9375d', 'request_id': 'req-e95ef559-0929-4752-a5d2-ab22819c19e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:55.287847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] The token cache is being invalidate because project c4ecf674bb624c06b1e6ef90afa9375d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:55.288197 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:55.289352 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e95ef559-0929-4752-a5d2-ab22819c19e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:55.290578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1412/2790] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:55 2022] DELETE /identity/v3/projects/c4ecf674bb624c06b1e6ef90afa9375d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:55.296311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.297002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.297002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.316316 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:55.317896 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:55.397957 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1379/2791] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:55.406340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.406626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.406902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.437446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:55.438657 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:55.447660 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1413/2792] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:55.451615 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.462489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc02e56-8136-4979-8523-e622d12111e5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.468947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.472994 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.473378 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.474040 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.474923 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:55.475635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.482635 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.493836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1380/2793] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:55.496231 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.507142 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b04d2-961e-4e4b-a5c2-36da5b6cc3e2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.511991 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.512662 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.512950 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.513232 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.513940 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.516451 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.543787 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1414/2794] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:55 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:55.556107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.568853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd435123-efc0-40ba-85c0-8b0472df38c7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.664422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.665181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.665469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.665749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.666461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.678884 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.705279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1381/2795] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:55 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:55.709378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.720536 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40defa-c242-4ef8-a546-cb1f1a2e3727 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.726128 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.726921 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.727268 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.727557 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.728295 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.729880 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.748816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1415/2796] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:55.757670 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.769438 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b4e6f-3179-4e0b-b0ca-5c7fa439e6da admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.783100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ee8c-6547-4c47-80ea-a08f4c7acbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.783100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ee8c-6547-4c47-80ea-a08f4c7acbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.783100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ee8c-6547-4c47-80ea-a08f4c7acbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.783100 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ee8c-6547-4c47-80ea-a08f4c7acbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.783599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ee8c-6547-4c47-80ea-a08f4c7acbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.783599 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ee8c-6547-4c47-80ea-a08f4c7acbe4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.792835 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1382/2797] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:55.797015 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:55.807499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830deb6-b27d-4f41-8bc3-64389dd0ad69 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:55.812465 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:55.813370 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.813658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.813937 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] PATH_INFO: `/v3/projects/db4a510818464632bebc7dd578829322/users/7fc3e42fc0ac4c56a37fdd305b958582/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.836136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4a510818464632bebc7dd578829322, user_id=7fc3e42fc0ac4c56a37fdd305b958582, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:55.840091 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:55.859124 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1416/2798] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:55 2022] PUT /identity/v3/projects/db4a510818464632bebc7dd578829322/users/7fc3e42fc0ac4c56a37fdd305b958582/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:55.870424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:55.870718 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:55.871000 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:55.879557 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:55.905652 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] MFA Rules not processed for user `7fc3e42fc0ac4c56a37fdd305b958582`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:55.906874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:55.997053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1383/2799] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:55.998283 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.103989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c1918-3820-48d3-82d7-cbf936bcca0a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.110145 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.111007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.111336 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.111678 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.112388 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.114613 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.159379 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1417/2800] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:55 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:56.163487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.175385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838536-fb15-4479-aa7c-0a708c3d4b14 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.232048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.232641 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.232945 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.233734 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.234424 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.236390 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.256633 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1384/2801] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:56 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:24:56.260883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.273741 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465829d-97da-4c27-a5fe-ae5ac6b6827e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.279863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.280631 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.280920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.281204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.281941 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.283608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.295025 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1418/2802] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:56.299890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.310513 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d1f7d-115b-41aa-85b7-e839a23c2191 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.316024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.317028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.317387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.317745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] PATH_INFO: `/v3/projects/2857d07886384b83b5cb12d6228f03b3/users/e0265775a49c467f944000cd4a85aa9c/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.333828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2857d07886384b83b5cb12d6228f03b3, user_id=e0265775a49c467f944000cd4a85aa9c, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.336838 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.351027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1385/2803] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:56 2022] PUT /identity/v3/projects/2857d07886384b83b5cb12d6228f03b3/users/e0265775a49c467f944000cd4a85aa9c/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:56.355159 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.366493 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87663cd4-c50e-492d-8225-449cb4cd93da admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.377266 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:56.428990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b4ac-35ed-472e-8bca-55b6c3df0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.435636 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b4ac-35ed-472e-8bca-55b6c3df0ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.435948 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b4ac-35ed-472e-8bca-55b6c3df0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.437102 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b4ac-35ed-472e-8bca-55b6c3df0ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.437865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b4ac-35ed-472e-8bca-55b6c3df0ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.439568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b4ac-35ed-472e-8bca-55b6c3df0ba3 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.450470 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1419/2804] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:56.454638 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.466646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bd7f4-5871-42b1-9951-d9ab662fe887 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.473679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.474609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.474894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.475446 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] PATH_INFO: `/v3/projects/2857d07886384b83b5cb12d6228f03b3/users/e0265775a49c467f944000cd4a85aa9c/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.477625 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2857d07886384b83b5cb12d6228f03b3, user_id=e0265775a49c467f944000cd4a85aa9c, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.480417 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.493143 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1386/2805] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:56 2022] PUT /identity/v3/projects/2857d07886384b83b5cb12d6228f03b3/users/e0265775a49c467f944000cd4a85aa9c/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:56.504092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.504411 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.504713 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.531729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] MFA Rules not processed for user `e0265775a49c467f944000cd4a85aa9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:56.533010 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:56.611437 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1420/2806] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:56.622767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.624745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:56.710150 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:56.717359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733e94a-15e6-4954-8f34-3172271167fb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.721423 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432aac0-fc1b-437b-97b4-60fe72caa7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.722185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432aac0-fc1b-437b-97b4-60fe72caa7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.722566 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432aac0-fc1b-437b-97b4-60fe72caa7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.722941 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432aac0-fc1b-437b-97b4-60fe72caa7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.740341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432aac0-fc1b-437b-97b4-60fe72caa7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.741888 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432aac0-fc1b-437b-97b4-60fe72caa7c4 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.753066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1387/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:56.829995 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:56.911250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbabb39-571e-41f1-9bf6-a03887c6c72f None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:56.916289 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:56.917190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:56.917476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:56.917753 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] PATH_INFO: `/v3/users/7fc3e42fc0ac4c56a37fdd305b958582` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:56.919009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc3e42fc0ac4c56a37fdd305b958582)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:56.921050 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:56.961815 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:56.971530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc3e42fc0ac4c56a37fdd305b958582'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:56.980466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc3e42fc0ac4c56a37fdd305b958582'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:56.982649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc3e42fc0ac4c56a37fdd305b958582'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.000747 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc3e42fc0ac4c56a37fdd305b958582'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.001773 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc3e42fc0ac4c56a37fdd305b958582'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.021551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1421/2808] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:56 2022] DELETE /identity/v3/users/7fc3e42fc0ac4c56a37fdd305b958582 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:57.026023 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:57.026318 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:57.026609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:57.045098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:57.046852 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:57.107666 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1388/2809] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:57.117704 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:57.119154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:57.178007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515d430-e483-407d-ba48-d1e56eb8e31a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:57.182378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:57.183287 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:57.183576 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:57.183862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:57.194253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:57.195808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:57.207913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1422/2810] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:24:57.493080 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:57.495329 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:57.511383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c03c1-af2f-41c4-bd72-d0dc482abe2b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:57.517056 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:57.517936 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:57.518223 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:57.518515 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] PATH_INFO: `/v3/projects/db4a510818464632bebc7dd578829322` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:57.520030 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4a510818464632bebc7dd578829322)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:57.521953 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:57.571257 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4a510818464632bebc7dd578829322', 'request_id': 'req-fa8ca1de-d9c3-4958-a1ad-96b968baa903'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.580833 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4a510818464632bebc7dd578829322', 'request_id': 'req-fa8ca1de-d9c3-4958-a1ad-96b968baa903'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.590651 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4a510818464632bebc7dd578829322', 'request_id': 'req-fa8ca1de-d9c3-4958-a1ad-96b968baa903'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.610203 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] The token cache is being invalidate because project db4a510818464632bebc7dd578829322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:57.610606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.611347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.612976 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1389/2811] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:57 2022] DELETE /identity/v3/projects/db4a510818464632bebc7dd578829322 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:57.616964 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:57.626971 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb1a12-f461-4281-a967-f65af6bf5f10 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:57.693792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:57.697380 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:57.700474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:57.700474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] PATH_INFO: `/v3/users/e0265775a49c467f944000cd4a85aa9c` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:57.700474 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0265775a49c467f944000cd4a85aa9c)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:57.703269 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:57.764968 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0265775a49c467f944000cd4a85aa9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.771881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0265775a49c467f944000cd4a85aa9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.773040 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0265775a49c467f944000cd4a85aa9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.778147 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:57.788524 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0265775a49c467f944000cd4a85aa9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.789285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-83651532-1a24-40b8-9f8d-e47e2a6b9e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0265775a49c467f944000cd4a85aa9c'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:57.811979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1423/2812] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:24:57 2022] DELETE /identity/v3/users/e0265775a49c467f944000cd4a85aa9c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:58.108034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.109196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:58.144106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ca1de-d9c3-4958-a1ad-96b968baa903 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.208647 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.209611 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.209900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.210178 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] PATH_INFO: `/v3/projects/2857d07886384b83b5cb12d6228f03b3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.211434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2857d07886384b83b5cb12d6228f03b3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.213352 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.229251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:58.272291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2857d07886384b83b5cb12d6228f03b3', 'request_id': 'req-4cacd8b6-1166-4924-ac98-835c764c929c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:58.279394 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2857d07886384b83b5cb12d6228f03b3', 'request_id': 'req-4cacd8b6-1166-4924-ac98-835c764c929c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:58.285842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2857d07886384b83b5cb12d6228f03b3', 'request_id': 'req-4cacd8b6-1166-4924-ac98-835c764c929c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:58.296525 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] The token cache is being invalidate because project 2857d07886384b83b5cb12d6228f03b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:24:58.296818 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:58.297456 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4cacd8b6-1166-4924-ac98-835c764c929c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:24:58.299134 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1390/2813] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:24:58 2022] DELETE /identity/v3/projects/2857d07886384b83b5cb12d6228f03b3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:24:58.304060 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.304523 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.304651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.323002 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:58.324285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:58.395945 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1424/2814] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:58.403542 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.403915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.404298 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.423636 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:58.424836 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:58.435516 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1391/2815] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:24:58.440520 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.450296 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77855b0-9c0e-4741-bbc1-dbac92aabc93 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.455530 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.456215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.456500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.456776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.457490 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:24:58.457796 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.459419 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.470979 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1425/2816] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:24:58.475429 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.485388 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad512dc2-22ff-43b5-bea4-a62cce3f12f8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.491002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.491752 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.492068 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.492306 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.493085 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.494950 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.524830 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1392/2817] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:24:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:58.525992 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.536455 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf70c9f-28b7-48eb-adc2-a232d345a5f0 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.594974 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.595688 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.595977 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.596261 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] PATH_INFO: `/v3/users` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.597963 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.600658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.627651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1426/2818] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:24:58 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:24:58.631931 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.643225 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931d2c5-9108-404c-8035-9bf4de12946c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.648553 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.649233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.649526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.649846 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.650998 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.652301 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.664531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1393/2819] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:24:58.668548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.679755 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a9a9f-bd16-4ff7-baab-befeea4b44dc admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.684591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b6434-6aa4-4c50-acb0-4438af790988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.685427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6434-6aa4-4c50-acb0-4438af790988 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.685790 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6434-6aa4-4c50-acb0-4438af790988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.686965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b6434-6aa4-4c50-acb0-4438af790988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.687820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6434-6aa4-4c50-acb0-4438af790988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.689452 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b6434-6aa4-4c50-acb0-4438af790988 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.700339 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1427/2820] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:24:58.705951 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.717665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3693456-4558-40c0-9adb-1a9169dcef6a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.723604 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.724512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.724800 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.725079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] PATH_INFO: `/v3/projects/d47413bed54442358ad4db040c8b8bc2/users/75daad8bcc734ed59733936cd7daa3e8/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.740726 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47413bed54442358ad4db040c8b8bc2, user_id=75daad8bcc734ed59733936cd7daa3e8, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.743505 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.768781 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1394/2821] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:24:58 2022] PUT /identity/v3/projects/d47413bed54442358ad4db040c8b8bc2/users/75daad8bcc734ed59733936cd7daa3e8/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:24:58.771850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.772149 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.772534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.800509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] MFA Rules not processed for user `75daad8bcc734ed59733936cd7daa3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:24:58.801899 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:58.838502 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:24:58.879325 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1428/2822] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:24:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:24:58.890107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:24:58.891770 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:24:58.952029 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6f377-f150-46b2-9bd9-8e8b3de4c2a0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:24:58.955685 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d283a-aa0e-48df-8497-78772f23f3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:24:58.956344 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d283a-aa0e-48df-8497-78772f23f3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:24:58.956639 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d283a-aa0e-48df-8497-78772f23f3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:24:58.956927 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d283a-aa0e-48df-8497-78772f23f3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:24:58.965492 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d283a-aa0e-48df-8497-78772f23f3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:24:58.966996 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d283a-aa0e-48df-8497-78772f23f3c1 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:24:58.977193 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1395/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:24:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:02.011717 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:02.077673 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc4325-b4bd-473b-a344-ed3782877341 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:02.082205 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:02.083157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.083450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.083733 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] PATH_INFO: `/v3/users/75daad8bcc734ed59733936cd7daa3e8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.084926 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75daad8bcc734ed59733936cd7daa3e8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:02.086898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:02.134445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75daad8bcc734ed59733936cd7daa3e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.142901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75daad8bcc734ed59733936cd7daa3e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.143549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75daad8bcc734ed59733936cd7daa3e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.156679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75daad8bcc734ed59733936cd7daa3e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.157958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75daad8bcc734ed59733936cd7daa3e8'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.170248 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1429/2824] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:25:02 2022] DELETE /identity/v3/users/75daad8bcc734ed59733936cd7daa3e8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:02.175341 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.175918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.175918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.193585 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:02.194827 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:02.233518 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:02.256118 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1396/2825] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:02.266958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:02.268644 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:02.327215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50711c34-48cd-49ef-953e-a061adcff64d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:02.330913 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2036-15e7-4332-bd60-a11d25c08906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:02.331593 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2036-15e7-4332-bd60-a11d25c08906 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.331884 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2036-15e7-4332-bd60-a11d25c08906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.332170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2036-15e7-4332-bd60-a11d25c08906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.338071 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:02.343611 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2036-15e7-4332-bd60-a11d25c08906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:02.346183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2036-15e7-4332-bd60-a11d25c08906 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:02.356349 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1430/2826] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:02.627771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:02.629242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:02.641948 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c486-7bdb-4227-9ff1-bf1e76e8f112 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:02.646665 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:02.647582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.647891 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.648170 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] PATH_INFO: `/v3/projects/d47413bed54442358ad4db040c8b8bc2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.649365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47413bed54442358ad4db040c8b8bc2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:02.651322 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:02.700938 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47413bed54442358ad4db040c8b8bc2', 'request_id': 'req-43e9249b-1175-408f-bcf8-9cbbabe958d7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.709211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47413bed54442358ad4db040c8b8bc2', 'request_id': 'req-43e9249b-1175-408f-bcf8-9cbbabe958d7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.715403 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47413bed54442358ad4db040c8b8bc2', 'request_id': 'req-43e9249b-1175-408f-bcf8-9cbbabe958d7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.726609 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] The token cache is being invalidate because project d47413bed54442358ad4db040c8b8bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:25:02.726906 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.727606 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-43e9249b-1175-408f-bcf8-9cbbabe958d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:02.729229 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1397/2827] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:25:02 2022] DELETE /identity/v3/projects/d47413bed54442358ad4db040c8b8bc2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:02.734186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.734487 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.734802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.752513 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:02.753719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:02.813849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1431/2828] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:02.823624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.823915 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.824198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.844048 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:02.845724 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:02.854027 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1398/2829] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:02.858360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:02.867957 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50af924-9112-4b99-a50b-b31428277fc2 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:02.872482 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:02.873075 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.873360 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.874137 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.874856 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:25:02.875895 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:02.876785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:02.888817 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1432/2830] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:25:02.893630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:02.904748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e9a2-0853-4b36-aacf-564a3cf9c75f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:02.910478 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:02.911099 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:02.911305 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.911656 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.911965 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.912687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:02.912850 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:02.914758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:02.930797 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405e86-f4a5-4434-9cfb-aea1d94d7341 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:02.937039 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:02.937936 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:02.938202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:02.938476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] PATH_INFO: `/v3/users/a2a550006e5c41fd97fb015f068b346b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:02.939847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a550006e5c41fd97fb015f068b346b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:02.941772 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:02.946876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1399/2831] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:25:02 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:25:02.947708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.007627 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a550006e5c41fd97fb015f068b346b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.027079 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48b4e5-06c6-46ef-a521-e430b0ad5e95 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.029903 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a550006e5c41fd97fb015f068b346b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.030877 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a550006e5c41fd97fb015f068b346b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.032028 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.032856 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.033300 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.033588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.034295 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.036365 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.043958 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a550006e5c41fd97fb015f068b346b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.044663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-dd7a4cc4-0125-44a8-abaa-b95f9cff7958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a550006e5c41fd97fb015f068b346b'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.058953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1433/2832] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:25:02 2022] DELETE /identity/v3/users/a2a550006e5c41fd97fb015f068b346b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:03.059536 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1400/2833] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:25:02 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:25:03.064862 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.065568 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.066043 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.066512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.067287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.086122 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03549b-c752-45a4-aac1-082a988bc637 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.092589 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:03.094350 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.123321 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:03.162196 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.162918 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.163279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.163568 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.164308 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.164785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:03.166002 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.177534 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1401/2834] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:25:03.181220 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.183005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1434/2835] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:03.192631 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a881ccc-d567-4398-8a90-c71cdccf452d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.193023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.194427 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.197297 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.197955 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.198246 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.198526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.199281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.200869 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.211692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1402/2836] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:25:03.215114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.224966 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f344ace-5649-4102-bcc6-06128ea9545d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.229769 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fbdaa-481c-4dd8-8e0f-71b3a8767fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.230634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fbdaa-481c-4dd8-8e0f-71b3a8767fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.230924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fbdaa-481c-4dd8-8e0f-71b3a8767fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.231311 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fbdaa-481c-4dd8-8e0f-71b3a8767fad admin admin] PATH_INFO: `/v3/projects/f31443fe0e7d41399eda8dae863e169b/users/2f310e479f6544028e958f730f65b4be/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.251490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fbdaa-481c-4dd8-8e0f-71b3a8767fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31443fe0e7d41399eda8dae863e169b, user_id=2f310e479f6544028e958f730f65b4be, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.254361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fbdaa-481c-4dd8-8e0f-71b3a8767fad admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.260785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb9517-e131-4d7a-8be4-971e45acc213 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.264989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.265645 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.265927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.266202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.270088 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1403/2837] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:25:03 2022] PUT /identity/v3/projects/f31443fe0e7d41399eda8dae863e169b/users/2f310e479f6544028e958f730f65b4be/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:25:03.275782 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.277469 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.280443 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.280743 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.281026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.287359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1435/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:25:03.307662 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] MFA Rules not processed for user `2f310e479f6544028e958f730f65b4be`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:03.308873 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.386494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1404/2839] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:03.394478 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.396011 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.457734 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f87d1-e6c5-4f4c-83e6-9443f913abfd service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.515199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.515859 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.516148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.516428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.525181 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.526618 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.536115 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1436/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:03.565563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.580383 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.582873 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.645963 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2d14e-0d3a-46a0-908c-3df08a7d0107 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.650157 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:03.650842 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.651540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.651851 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.652129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] PATH_INFO: `/v3/users/2f310e479f6544028e958f730f65b4be` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.653383 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f310e479f6544028e958f730f65b4be)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.655900 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.657098 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d4e06-4976-40b5-9ed5-492df26d27d7 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.661847 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.662724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.663012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.663338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] PATH_INFO: `/v3/projects/9b28897ace8744e985a1ca8d3f4327ff` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.664570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b28897ace8744e985a1ca8d3f4327ff)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.666497 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.677501 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:03.719196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b28897ace8744e985a1ca8d3f4327ff', 'request_id': 'req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.720205 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f310e479f6544028e958f730f65b4be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.726813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b28897ace8744e985a1ca8d3f4327ff', 'request_id': 'req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.728808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f310e479f6544028e958f730f65b4be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.734158 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b28897ace8744e985a1ca8d3f4327ff', 'request_id': 'req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.741435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f310e479f6544028e958f730f65b4be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.742089 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f310e479f6544028e958f730f65b4be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.745381 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] The token cache is being invalidate because project 9b28897ace8744e985a1ca8d3f4327ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:25:03.745677 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.746342 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5ebe8ffb-6b68-4595-9ef6-e18ef741e9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.747981 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1437/2841] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:25:03 2022] DELETE /identity/v3/projects/9b28897ace8744e985a1ca8d3f4327ff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:25:03.749385 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1cf7a6a9-0d52-4cdf-9e1c-5c841a01cf53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f310e479f6544028e958f730f65b4be'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:03.752608 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461d16-74ec-4c80-99ce-1697d095bc0e None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.752907 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461d16-74ec-4c80-99ce-1697d095bc0e None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.753211 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461d16-74ec-4c80-99ce-1697d095bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.755671 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1405/2842] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:25:03 2022] DELETE /identity/v3/users/2f310e479f6544028e958f730f65b4be => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:03.759843 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.760132 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.760410 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.771706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-d4461d16-74ec-4c80-99ce-1697d095bc0e None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:03.772920 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-d4461d16-74ec-4c80-99ce-1697d095bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.777776 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:03.778928 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.838509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1438/2843] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:03.849247 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.849547 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.849820 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1406/2844] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:03.849962 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.859185 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.860563 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.867905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:03.869077 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:03.877059 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1439/2845] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:03.881023 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.890328 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60cd8c-4001-4e6f-a882-c7bf3705b63c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.894966 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.895639 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.895930 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.896274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.896924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80059) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:25:03.897230 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.898800 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.917721 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1440/2846] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 11:25:03.918679 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.920700 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bf00c-0b10-4e06-b472-12b854760a61 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.924510 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.925186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.925453 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.925739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.928404 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cd706-a876-4142-80cc-ea3fbe492a28 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:03.933012 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:03.933771 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:03.934135 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:03.934494 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:03.935285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.935406 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:03.937066 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.937480 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:03.946956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1407/2847] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:25:03.970561 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1441/2848] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:25:03.971758 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:03.981826 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7db97b-2a3b-4bbd-a55d-7b016eb9350c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.024146 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:04.050876 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.051704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.052181 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.052526 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.053327 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.055546 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.085619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1408/2849] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:25:03 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:25:04.089816 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.100989 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108accd-b230-4a66-b7e6-830f97d684af admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.108540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.108540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.108540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.108540 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.109164 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.109924 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.120196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1442/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:25:04.125157 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.135533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dfdf9-0127-4315-ad46-95009c80808d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.141486 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28608f91-12dc-4baa-a95c-5cfc6125ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.142610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608f91-12dc-4baa-a95c-5cfc6125ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.142610 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608f91-12dc-4baa-a95c-5cfc6125ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.142828 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28608f91-12dc-4baa-a95c-5cfc6125ad9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.143485 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608f91-12dc-4baa-a95c-5cfc6125ad9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.145211 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28608f91-12dc-4baa-a95c-5cfc6125ad9f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.155722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1409/2851] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:25:04.159809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.171445 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d02e-f5f0-4c43-9505-85f1e2ad2376 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.176635 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.177780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.178166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.178534 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] PATH_INFO: `/v3/projects/7ce429c0cf5c40c183d7423ab115b2c8/users/2135fc444eea4d6c8e1269af71fadfd4/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.195166 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce429c0cf5c40c183d7423ab115b2c8, user_id=2135fc444eea4d6c8e1269af71fadfd4, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.197901 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.212175 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1443/2852] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:25:04 2022] PUT /identity/v3/projects/7ce429c0cf5c40c183d7423ab115b2c8/users/2135fc444eea4d6c8e1269af71fadfd4/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:04.217147 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.217616 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.217778 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.235487 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:04.236682 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:04.249118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.251285 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:04.266008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:04.320780 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1410/2853] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:04.331768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.333208 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:04.334832 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018508bf-2abc-47e1-91e0-4940f91bc52b admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.339828 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.340706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.341126 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.341412 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] PATH_INFO: `/v3/projects/f31443fe0e7d41399eda8dae863e169b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.342654 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31443fe0e7d41399eda8dae863e169b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.344606 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.394745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d692b-f22a-46b8-bbcc-f604ea283d13 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.395003 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31443fe0e7d41399eda8dae863e169b', 'request_id': 'req-fa5ce126-dc6f-4005-a108-540b2f67a36e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:04.403740 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31443fe0e7d41399eda8dae863e169b', 'request_id': 'req-fa5ce126-dc6f-4005-a108-540b2f67a36e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:04.411598 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31443fe0e7d41399eda8dae863e169b', 'request_id': 'req-fa5ce126-dc6f-4005-a108-540b2f67a36e'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:04.423865 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] The token cache is being invalidate because project f31443fe0e7d41399eda8dae863e169b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:25:04.424180 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:04.424888 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-fa5ce126-dc6f-4005-a108-540b2f67a36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:04.426491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1444/2854] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:25:04 2022] DELETE /identity/v3/projects/f31443fe0e7d41399eda8dae863e169b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:25:04.430978 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794f51-b6d5-4e67-bd50-c9f92a77c374 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.431335 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794f51-b6d5-4e67-bd50-c9f92a77c374 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.431651 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794f51-b6d5-4e67-bd50-c9f92a77c374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.451509 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-a3794f51-b6d5-4e67-bd50-c9f92a77c374 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:04.453245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-a3794f51-b6d5-4e67-bd50-c9f92a77c374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:04.453619 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.454281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.454572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.454855 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.456688 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:04.492903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:04.515878 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1445/2855] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:04.525706 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.526046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.527079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.531291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.532771 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.543630 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1411/2856] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:25:04.549781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:04.551005 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:04.559281 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1446/2857] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:04.564198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.574215 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53127918-fa74-40d1-a635-a6f94a99a959 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.579574 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.580242 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.580527 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.580803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.581528 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 11:25:04.581864 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.583533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.595343 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1412/2858] 10.222.0.48 () {58 vars in 1152 bytes} [Wed Jun 29 11:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 11:25:04.599578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.610154 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b9824-616c-420d-b10f-42440dad9e90 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.614956 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.615649 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.615934 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.616212 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.616898 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.618863 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.655416 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1447/2859] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:25:04 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 11:25:04.659494 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.669387 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b778a00-1eaa-4cfd-ae4c-a24039576e5e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.726233 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.726895 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.727202 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.727481 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.728182 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.730092 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.760714 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1413/2860] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:25:04 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:25:04.762191 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.773136 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ba7eb-8986-4979-89eb-2778b718eb33 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.778069 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.778808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.779202 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.779551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.780351 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.782048 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.788538 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:04.796318 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1448/2861] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:25:04.800062 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.810624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f3ac3-901c-47fa-b1a8-6cbf6cf3cfdf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.816813 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76540b55-0edb-4c28-930b-45859ee304c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.817565 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76540b55-0edb-4c28-930b-45859ee304c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.817863 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76540b55-0edb-4c28-930b-45859ee304c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.818174 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76540b55-0edb-4c28-930b-45859ee304c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.818901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76540b55-0edb-4c28-930b-45859ee304c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.820570 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76540b55-0edb-4c28-930b-45859ee304c0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.831601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1414/2862] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:25:04.835692 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:04.849581 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575f4b5-e734-4771-857a-ebb0606072d5 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:04.858632 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:04.859578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] REQUEST_METHOD: `PUT` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.859862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.860139 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] PATH_INFO: `/v3/projects/72f285b185c24e44a5020a7e03560fb8/users/d70714e5abf9432bb9e7a8c170a03a50/roles/bcc6944090e84b989e96027d0859ed4b` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.878501 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f285b185c24e44a5020a7e03560fb8, user_id=d70714e5abf9432bb9e7a8c170a03a50, role_id=bcc6944090e84b989e96027d0859ed4b)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:04.881933 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:04.896693 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1449/2863] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:25:04 2022] PUT /identity/v3/projects/72f285b185c24e44a5020a7e03560fb8/users/d70714e5abf9432bb9e7a8c170a03a50/roles/bcc6944090e84b989e96027d0859ed4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:04.907672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e2f8a-b1cf-4c81-8400-2225fee54f36 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:04.907975 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e2f8a-b1cf-4c81-8400-2225fee54f36 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:04.908271 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e2f8a-b1cf-4c81-8400-2225fee54f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:04.938175 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-550e2f8a-b1cf-4c81-8400-2225fee54f36 None None] MFA Rules not processed for user `d70714e5abf9432bb9e7a8c170a03a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:04.939359 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-550e2f8a-b1cf-4c81-8400-2225fee54f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:05.024672 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1415/2864] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:05.036882 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:05.038658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:05.109791 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c5825-8b5e-44da-bff8-b06a1b8fb32d admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:05.114234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adcb515e83b3484f9e93e18497fbbdfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:05.114970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:05.115344 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:05.116009 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:05.125203 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:05.127397 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:05.137172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1450/2865] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:08.857053 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:08.857558 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:08.857853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:08.888879 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] MFA Rules not processed for user `2135fc444eea4d6c8e1269af71fadfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:08.890821 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:08.900304 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:08.967775 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1416/2866] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:08.972855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:08.975571 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:09.054275 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0b1d8-c48b-4ec1-927c-fcd9850d0a18 service cinder] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:09.059908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:09.061849 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:09.062144 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:09.062426 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] PATH_INFO: `/v3/projects` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:09.063179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:09.065460 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:09.096549 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1451/2867] 10.222.0.48 () {60 vars in 1152 bytes} [Wed Jun 29 11:25:08 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:25:09.100552 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:09.118035 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38498191-4dba-4f47-a447-6e57b87c61e5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:09.208372 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:09.209077 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:09.209364 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:09.209642 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:09.210367 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:09.212551 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:09.236247 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1417/2868] 10.222.0.48 () {60 vars in 1143 bytes} [Wed Jun 29 11:25:09 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 11:25:09.240990 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:09.254186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10c86b-e971-4a86-b275-298add5b573e admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:09.260546 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:09.261556 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:09.261965 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:09.262570 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:09.263776 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:09.265875 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:09.282953 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1452/2869] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 11:25:09.285990 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:09.300107 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e39a5-8388-4469-8ba3-0ae27cd8db5d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:09.305374 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:09.306468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:09.306991 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:09.307400 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] PATH_INFO: `/v3/projects/94fe97bc7fe6452f93e2f684b2376269/users/2524ebcaa9c94657adcbddb7b2efa43b/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:09.328224 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fe97bc7fe6452f93e2f684b2376269, user_id=2524ebcaa9c94657adcbddb7b2efa43b, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:09.331256 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:09.347617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1418/2870] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:25:09 2022] PUT /identity/v3/projects/94fe97bc7fe6452f93e2f684b2376269/users/2524ebcaa9c94657adcbddb7b2efa43b/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:09.351120 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:09.361646 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa424ee-2d59-41ad-8310-ed5a06fc6abe admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:09.410663 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:09.421669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:09.422340 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:09.422626 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:09.422908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:09.423661 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:09.425271 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:09.437092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1453/2871] 10.222.0.48 () {58 vars in 1121 bytes} [Wed Jun 29 11:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 11:25:09.441096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:09.451472 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fa625-ab82-4d25-b659-15e14709369c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:09.456588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bbc0d-474e-4ddd-8335-a1e149d07b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:09.457572 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bbc0d-474e-4ddd-8335-a1e149d07b44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:09.457933 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bbc0d-474e-4ddd-8335-a1e149d07b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:09.458289 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bbc0d-474e-4ddd-8335-a1e149d07b44 admin admin] PATH_INFO: `/v3/projects/94fe97bc7fe6452f93e2f684b2376269/users/2524ebcaa9c94657adcbddb7b2efa43b/roles/578ff99b6c984bc68a9c8cc5d9181c48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:09.460591 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bbc0d-474e-4ddd-8335-a1e149d07b44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fe97bc7fe6452f93e2f684b2376269, user_id=2524ebcaa9c94657adcbddb7b2efa43b, role_id=578ff99b6c984bc68a9c8cc5d9181c48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:09.463482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bbc0d-474e-4ddd-8335-a1e149d07b44 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:09.475355 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1419/2872] 10.222.0.48 () {60 vars in 1482 bytes} [Wed Jun 29 11:25:09 2022] PUT /identity/v3/projects/94fe97bc7fe6452f93e2f684b2376269/users/2524ebcaa9c94657adcbddb7b2efa43b/roles/578ff99b6c984bc68a9c8cc5d9181c48 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:25:12.054783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:12.057242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:12.168224 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55eba0-2afa-4c1c-b063-65fd3bc0a781 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:12.250375 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:12.251174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:12.251428 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:12.251715 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:12.253597 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:12.287601 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:12.289284 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:12.309932 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1454/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:15.098084 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0214-5704-418c-94e5-b1e5adb638bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:15.098786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0214-5704-418c-94e5-b1e5adb638bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:15.099240 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f0214-5704-418c-94e5-b1e5adb638bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:15.134251 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-515f0214-5704-418c-94e5-b1e5adb638bf None None] MFA Rules not processed for user `2524ebcaa9c94657adcbddb7b2efa43b`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:15.135531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-515f0214-5704-418c-94e5-b1e5adb638bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:15.214694 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:15.250255 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1420/2874] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:15.262681 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:15.264799 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:15.369438 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772d089-6c2a-4933-ba89-be55f6913868 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:15.374833 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '012fd3c15c444f5a8519f1b44fbcd5b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:15.376569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:15.377172 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:15.377737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:15.443883 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=100 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:15.469922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:15.471739 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:15.482079 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1455/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:15.599640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:15.600098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:15.600347 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:15.619047 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:15.620279 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:15.698049 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1421/2876] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:25:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:25:15.756389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:15.757905 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:15.832808 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241f57-3158-4f22-913e-25c8fa4defdc service glance] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:15.838737 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897b3e-d58b-4c8c-98ae-854ae774bdf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:15.839500 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897b3e-d58b-4c8c-98ae-854ae774bdf9 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:15.839788 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897b3e-d58b-4c8c-98ae-854ae774bdf9 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:15.840065 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897b3e-d58b-4c8c-98ae-854ae774bdf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:15.849046 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897b3e-d58b-4c8c-98ae-854ae774bdf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:15.850813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897b3e-d58b-4c8c-98ae-854ae774bdf9 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:15.859548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1456/2877] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:25:15.943704 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:16.095554 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a124484-3c83-4317-9755-6193250c6ea2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:16.104997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:16.106803 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:16.107307 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:16.108370 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] PATH_INFO: `/v3/users/d70714e5abf9432bb9e7a8c170a03a50` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:16.111634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70714e5abf9432bb9e7a8c170a03a50)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:16.113983 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:16.183253 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70714e5abf9432bb9e7a8c170a03a50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:16.205962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70714e5abf9432bb9e7a8c170a03a50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:16.227320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70714e5abf9432bb9e7a8c170a03a50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:16.228114 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70714e5abf9432bb9e7a8c170a03a50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:16.243692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70714e5abf9432bb9e7a8c170a03a50'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:16.256179 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1422/2878] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:25:15 2022] DELETE /identity/v3/users/d70714e5abf9432bb9e7a8c170a03a50 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:16.260889 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:16.261378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:16.261824 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:16.300548 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] MFA Rules not processed for user `ba85a3628d384dd78869d3e23b87ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:16.302683 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:16.422260 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1457/2879] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:16.434141 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:16.435853 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:16.454587 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:16.521997 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ad1fa-7d78-4858-aa3d-ff06ea356947 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:16.528391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2afc83-8a17-4872-b6fb-961dc3f3bd8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:16.530414 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2afc83-8a17-4872-b6fb-961dc3f3bd8d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:16.530935 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2afc83-8a17-4872-b6fb-961dc3f3bd8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:16.531539 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2afc83-8a17-4872-b6fb-961dc3f3bd8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:16.543231 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2afc83-8a17-4872-b6fb-961dc3f3bd8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:16.545514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2afc83-8a17-4872-b6fb-961dc3f3bd8d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:16.564947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1423/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:17.093186 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:17.094802 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:17.138160 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cd00-6047-42aa-beb9-26b0e3f08ca6 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:17.157027 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:17.157922 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:17.158215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:17.158499 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] PATH_INFO: `/v3/projects/72f285b185c24e44a5020a7e03560fb8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:17.160347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f285b185c24e44a5020a7e03560fb8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:17.167323 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:17.283820 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f285b185c24e44a5020a7e03560fb8', 'request_id': 'req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:17.297301 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f285b185c24e44a5020a7e03560fb8', 'request_id': 'req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:17.312998 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f285b185c24e44a5020a7e03560fb8', 'request_id': 'req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:17.320835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:17.332114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] The token cache is being invalidate because project 72f285b185c24e44a5020a7e03560fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:25:17.332488 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:17.333472 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-2b21893b-24bd-4ca4-b0c9-1afd91a43af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:25:17.336954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1458/2881] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:25:17 2022] DELETE /identity/v3/projects/72f285b185c24e44a5020a7e03560fb8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:25:25.649489 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:25.650031 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:25.650149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:25.667962 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] MFA Rules not processed for user `2135fc444eea4d6c8e1269af71fadfd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:25.669149 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:25.728376 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1424/2882] 10.222.0.48 () {58 vars in 957 bytes} [Wed Jun 29 11:25:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:27.337306 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=2 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:27.574852 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:27.575187 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:27.575481 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:27.605059 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:27.605623 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:25:27.606680 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:27.607312 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:27.680007 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1459/2883] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jun 29 11:25:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:25:27.680377 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9fe14-724f-47db-b82a-4c7d4af9525c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:27.684418 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:27.685078 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:27.685903 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:27.686186 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:27.688254 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:27.698038 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:27.700338 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:27.764582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:27.766034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:27.784687 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1425/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:25:27.794559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3f44-070a-4c6f-bc71-2be6e8981000 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:27.802073 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:27.802818 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:27.803153 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:27.803446 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:27.814707 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:27.817026 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:27.829729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1460/2885] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:25:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 11:25:30.484573 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:30.485498 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:30.498748 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:30.675655 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b49f3-e39f-4155-95e7-c80699d2c5d9 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:30.682409 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:30.683102 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:30.683946 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:30.684239 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:30.687248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:30.704608 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:30.706391 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:30.721791 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1426/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:37.823841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=57 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:40.716309 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=30 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:25:49.019258 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:25:49.028789 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854ac1-289a-4d4f-8688-a68dc8538f19 service swift] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:25:49.032927 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:25:49.033572 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:25:49.033862 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:25:49.034143 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:25:49.035917 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:25:49.100462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:25:49.101909 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7ec22-83a2-4593-b7b6-c3facf5aca59 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:25:49.112308 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1461/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:25:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:25:59.107316 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=30 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:26:48.147284 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:26:48.148732 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:26:48.216696 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf97f6-8780-43dc-8e79-f087b691ae5d service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:26:48.225320 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:26:48.225984 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:26:48.226274 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:26:48.226559 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:26:48.229026 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:26:48.243324 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:26:48.244956 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:26:48.255667 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1427/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:26:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 11:26:58.251419 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=32 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:23.624759 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:23.625313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:23.625313 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:23.643114 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] MFA Rules not processed for user `843ec60c1cce46738de1afa2accae5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:27:23.644305 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:23.651353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1462/2889] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jun 29 11:27:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:27:23.690702 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:23.701874 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53aba2-e214-4a92-a333-65d107647348 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:23.707375 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45862644baba4528bd6dbe4dab092089', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:23.708006 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:23.708291 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:23.708576 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:23.716447 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:23.718005 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:23.725917 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1428/2890] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jun 29 11:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 11:27:27.050687 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:27.064107 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37430188-972d-4f74-b45a-650fedd77ee7 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:27.069068 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:27.069719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:27.070016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:27.070300 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:27.074910 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:27.090022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:27.092347 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:27.105264 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1463/2891] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:27:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:27:30.356317 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:30.357768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:30.422815 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea13739-db87-44c7-826f-fcf9ca41414a service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:30.427342 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:30.428207 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:30.428490 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:30.428768 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] PATH_INFO: `/v3/users/2135fc444eea4d6c8e1269af71fadfd4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:30.429934 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2135fc444eea4d6c8e1269af71fadfd4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:30.431930 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:30.476461 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2135fc444eea4d6c8e1269af71fadfd4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.483602 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2135fc444eea4d6c8e1269af71fadfd4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.495564 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2135fc444eea4d6c8e1269af71fadfd4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.496198 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2135fc444eea4d6c8e1269af71fadfd4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.503540 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2135fc444eea4d6c8e1269af71fadfd4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.509281 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1429/2892] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:27:30 2022] DELETE /identity/v3/users/2135fc444eea4d6c8e1269af71fadfd4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:27:30.683467 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:30.696944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf08ce-9e8a-4490-a9f6-075887630a1d service placement] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:30.755310 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:30.756188 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:30.756476 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:30.756783 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] PATH_INFO: `/v3/projects/7ce429c0cf5c40c183d7423ab115b2c8` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:30.757970 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce429c0cf5c40c183d7423ab115b2c8)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:30.759902 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:30.809814 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce429c0cf5c40c183d7423ab115b2c8', 'request_id': 'req-49b0f129-f496-4d4b-8eae-190187b67d5a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.817669 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce429c0cf5c40c183d7423ab115b2c8', 'request_id': 'req-49b0f129-f496-4d4b-8eae-190187b67d5a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.824377 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce429c0cf5c40c183d7423ab115b2c8', 'request_id': 'req-49b0f129-f496-4d4b-8eae-190187b67d5a'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.836666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] The token cache is being invalidate because project 7ce429c0cf5c40c183d7423ab115b2c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:27:30.836666 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.837535 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.839190 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1464/2893] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:27:30 2022] DELETE /identity/v3/projects/7ce429c0cf5c40c183d7423ab115b2c8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:27:30.843183 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:30.844613 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:30.858093 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac324d-47e1-432e-942e-e5ce032a3707 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:30.916140 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:30.916947 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:30.917230 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:30.917514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] PATH_INFO: `/v3/users/2524ebcaa9c94657adcbddb7b2efa43b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:30.918698 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2524ebcaa9c94657adcbddb7b2efa43b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:30.920692 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:30.926469 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:30.974889 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2524ebcaa9c94657adcbddb7b2efa43b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.982129 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2524ebcaa9c94657adcbddb7b2efa43b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.994865 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2524ebcaa9c94657adcbddb7b2efa43b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:30.995588 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2524ebcaa9c94657adcbddb7b2efa43b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.002514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2524ebcaa9c94657adcbddb7b2efa43b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.008360 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1430/2894] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:27:30 2022] DELETE /identity/v3/users/2524ebcaa9c94657adcbddb7b2efa43b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 11:27:31.181253 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:31.182809 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:31.196870 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0f129-f496-4d4b-8eae-190187b67d5a admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:31.264204 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:31.265563 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:31.265855 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:31.266234 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] PATH_INFO: `/v3/projects/94fe97bc7fe6452f93e2f684b2376269` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:31.268330 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fe97bc7fe6452f93e2f684b2376269)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:31.271569 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:31.284215 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:31.322401 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fe97bc7fe6452f93e2f684b2376269', 'request_id': 'req-5de7b46d-a0e9-42ae-8140-1be20aabe980'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.331170 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fe97bc7fe6452f93e2f684b2376269', 'request_id': 'req-5de7b46d-a0e9-42ae-8140-1be20aabe980'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.338585 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fe97bc7fe6452f93e2f684b2376269', 'request_id': 'req-5de7b46d-a0e9-42ae-8140-1be20aabe980'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.349729 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] The token cache is being invalidate because project 94fe97bc7fe6452f93e2f684b2376269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80059) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:27:31.350016 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.350684 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-5de7b46d-a0e9-42ae-8140-1be20aabe980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:27:31.352462 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1465/2895] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:27:31 2022] DELETE /identity/v3/projects/94fe97bc7fe6452f93e2f684b2376269 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:27:39.656901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:39.658349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:39.716422 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcb6be-a77c-4075-bb74-bdd34fccd38c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:39.767521 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:39.768176 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:39.768468 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:39.768749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:39.770524 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:39.780063 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:39.781514 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a062-caee-4250-b187-32151d8f33c7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:39.790349 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1431/2896] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:27:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:27:40.900653 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12e8f-2036-4631-9734-226afe72f204 None None] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:40.901263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12e8f-2036-4631-9734-226afe72f204 None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:40.901263 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12e8f-2036-4631-9734-226afe72f204 None None] PATH_INFO: `/` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:40.902578 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1466/2897] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:27:40.908640 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54731c-f2f3-4876-91b4-53aaaac0e199 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:40.909106 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54731c-f2f3-4876-91b4-53aaaac0e199 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:40.909326 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54731c-f2f3-4876-91b4-53aaaac0e199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:40.927603 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fa54731c-f2f3-4876-91b4-53aaaac0e199 None None] MFA Rules not processed for user `f69233ef76fb44b78ac88a111c883182`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:27:40.928942 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fa54731c-f2f3-4876-91b4-53aaaac0e199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:40.935624 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1432/2898] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:27:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 11:27:40.950389 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12e8f-2036-4631-9734-226afe72f204 None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:40.952148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-0dc12e8f-2036-4631-9734-226afe72f204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:40.965752 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12e8f-2036-4631-9734-226afe72f204 None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:40.969378 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2115-82f5-4a89-8116-8f88d316da8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:40.970022 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2115-82f5-4a89-8116-8f88d316da8c service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:40.970309 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2115-82f5-4a89-8116-8f88d316da8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:40.970591 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2115-82f5-4a89-8116-8f88d316da8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:40.978001 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2115-82f5-4a89-8116-8f88d316da8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:40.979464 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2115-82f5-4a89-8116-8f88d316da8c service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:40.987785 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1467/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:27:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:27:41.069729 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40f8d-f97b-4f0b-94a1-b48fbd97a2df None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:41.070024 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40f8d-f97b-4f0b-94a1-b48fbd97a2df None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:41.070302 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40f8d-f97b-4f0b-94a1-b48fbd97a2df None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:41.071722 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1433/2900] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jun 29 11:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 11:27:41.076533 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] REQUEST_METHOD: `POST` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:41.076897 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:41.077183 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:41.097163 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.auth.core [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] MFA Rules not processed for user `14b23668139e429bacd32a5d4fc0994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80059) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 11:27:41.098385 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:27:41.162908 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1468/2901] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jun 29 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 11:27:41.173582 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40f8d-f97b-4f0b-94a1-b48fbd97a2df None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:27:41.184361 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40f8d-f97b-4f0b-94a1-b48fbd97a2df None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:27:41.188708 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:27:41.189334 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:27:41.189617 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:27:41.189894 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:27:41.206412 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:27:41.207875 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:27:41.218439 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1434/2902] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:27:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:27:51.153769 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:27:51.213785 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:28:51.983070 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:28:51.992551 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce4ce1-87e6-4302-987d-cccb9fd08b4c None None] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:28:51.996118 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:28:51.996765 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:28:51.997045 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:28:51.997320 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:28:51.999179 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:28:52.008868 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:28:52.010274 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:28:52.018559 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1469/2903] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:28:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:29:02.014806 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=6 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:03.625336 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:03.626155 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:03.641880 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3af719-de2a-4eb1-aa17-db3fdfadfd9a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:03.648421 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14b23668139e429bacd32a5d4fc0994e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:03.649213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:03.649507 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:03.649790 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:03.651712 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:03.665098 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:03.666745 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:03.679533 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1435/2904] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:29:03.813466 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:03.825174 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f374ae-3ce1-4c46-b326-de04d4378976 service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:03.828881 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:03.829656 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:03.830008 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:03.830353 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:03.832196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:03.846781 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:03.848245 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:03.859443 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1470/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:29:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:29:05.037707 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:05.039199 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:05.050601 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c96de-1fa5-4660-b654-27281d9cf83b service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:05.054190 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f69233ef76fb44b78ac88a111c883182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:05.054767 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:05.055086 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:05.055434 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:05.057212 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:05.070786 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:05.072248 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:05.083003 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1436/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:29:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:29:13.700604 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:13.702148 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:13.766996 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7fb0-5e60-4406-8fad-9c7b5be2228d service neutron] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:13.771699 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:13.772719 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:13.773017 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:13.773307 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] PATH_INFO: `/v3/users/2b1fe9b9f4724a949c45c9014888bc28` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:13.774555 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1fe9b9f4724a949c45c9014888bc28)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:13.776450 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:13.823076 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1fe9b9f4724a949c45c9014888bc28'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:13.831574 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1fe9b9f4724a949c45c9014888bc28'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:13.832196 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1fe9b9f4724a949c45c9014888bc28'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:13.844092 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1fe9b9f4724a949c45c9014888bc28'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:13.844724 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1fe9b9f4724a949c45c9014888bc28'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:13.856746 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1471/2907] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:29:13 2022] DELETE /identity/v3/users/2b1fe9b9f4724a949c45c9014888bc28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:29:14.022262 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:14.033292 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d599c-e8cc-4c49-af64-dbf715e937a4 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:14.095890 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:14.096749 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:14.097034 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:14.097312 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] PATH_INFO: `/v3/projects/471926d4c8aa4814a6e89523e2466d92` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:14.098482 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] RBAC: Authorizing `identity:delete_project(project_id=471926d4c8aa4814a6e89523e2466d92)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:14.100924 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:14.146529 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471926d4c8aa4814a6e89523e2466d92', 'request_id': 'req-ea1643a8-77d9-4d08-9f48-4d61b45a022b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.153646 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471926d4c8aa4814a6e89523e2466d92', 'request_id': 'req-ea1643a8-77d9-4d08-9f48-4d61b45a022b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.159805 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471926d4c8aa4814a6e89523e2466d92', 'request_id': 'req-ea1643a8-77d9-4d08-9f48-4d61b45a022b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.170348 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] The token cache is being invalidate because project 471926d4c8aa4814a6e89523e2466d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:29:14.170634 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.171287 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.172808 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1437/2908] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:29:14 2022] DELETE /identity/v3/projects/471926d4c8aa4814a6e89523e2466d92 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:29:14.176780 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:14.178165 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:14.191944 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a267f2-52ee-4dea-b59c-23fbbfeb03e9 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:14.248658 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:14.249544 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:14.249835 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:14.250121 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] PATH_INFO: `/v3/users/546d6193afe3452985de2a4d02170564` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:14.251334 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546d6193afe3452985de2a4d02170564)` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:14.253250 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:14.258560 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:14.300242 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546d6193afe3452985de2a4d02170564'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.307359 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546d6193afe3452985de2a4d02170564'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.307975 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546d6193afe3452985de2a4d02170564'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.320491 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546d6193afe3452985de2a4d02170564'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.321162 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.notifications [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546d6193afe3452985de2a4d02170564'} {{(pid=80059) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.333810 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1472/2909] 10.222.0.48 () {58 vars in 1223 bytes} [Wed Jun 29 11:29:14 2022] DELETE /identity/v3/users/546d6193afe3452985de2a4d02170564 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:29:14.503788 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:29:14.505213 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:29:14.519538 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1643a8-77d9-4d08-9f48-4d61b45a022b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:29:14.577236 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba85a3628d384dd78869d3e23b87ec91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d95d128265441e8d2bda222376dded', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:29:14.578111 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:29:14.578398 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:29:14.578679 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] PATH_INFO: `/v3/projects/1486fd2699974dc5871ceb080c3c1c99` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:29:14.579901 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1486fd2699974dc5871ceb080c3c1c99)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:29:14.581811 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:29:14.588739 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:14.630096 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1486fd2699974dc5871ceb080c3c1c99', 'request_id': 'req-369c4546-4e9e-4e88-aa52-de4fa62b5826'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.637531 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1486fd2699974dc5871ceb080c3c1c99', 'request_id': 'req-369c4546-4e9e-4e88-aa52-de4fa62b5826'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.643645 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1486fd2699974dc5871ceb080c3c1c99', 'request_id': 'req-369c4546-4e9e-4e88-aa52-de4fa62b5826'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.654512 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] The token cache is being invalidate because project 1486fd2699974dc5871ceb080c3c1c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 29 11:29:14.654799 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.655435 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-369c4546-4e9e-4e88-aa52-de4fa62b5826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 29 11:29:14.656982 dv-cinder-847335-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1438/2910] 10.222.0.48 () {58 vars in 1232 bytes} [Wed Jun 29 11:29:14 2022] DELETE /identity/v3/projects/1486fd2699974dc5871ceb080c3c1c99 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 11:29:24.330302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:29:24.651643 dv-cinder-847335-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 11:31:51.442813 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Authenticating user token {{(pid=80059) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 11:31:51.444302 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:31:51.582199 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78194ea-1c13-45ee-8488-cad05b37d714 admin admin] Validating token access rules against request {{(pid=80059) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 11:31:51.639573 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8463ca23f8c447dfad7ae62e7ba084e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c61084d9278a48c4a3bbe355525e62a6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80059) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 11:31:51.640222 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] REQUEST_METHOD: `GET` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 11:31:51.640512 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] SCRIPT_NAME: `/identity` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 11:31:51.640792 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80059) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 11:31:51.642567 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.fernet_utils [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80059) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 11:31:51.655151 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 11:31:51.656841 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4b912-04ae-4df1-a8e5-9db30f0b1493 service placement] RBAC: Authorization granted {{(pid=80059) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 11:31:51.667405 dv-cinder-847335-2-smb devstack@keystone.service[80059]: [pid: 80059|app: 0|req: 1473/2911] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jun 29 11:31:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 11:32:01.662954 dv-cinder-847335-2-smb devstack@keystone.service[80059]: DEBUG dbcounter [-] [80059] Writing DB stats keystone:SELECT=89 {{(pid=80059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}